Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
About the role
- Full-Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Responsibilities
- Analyze large, and complex, data sets
- Design, develop and coordinate the generation of Data Pipelines
- Work collaboratively with team to plan and solve complex problems
- Design for, or optimize existing pipelines, for performance and cost
Requirements
- Expert Python Developer
- Strong SQL Developer
- Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
- Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
- Strong Automation Experience
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
- Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
- Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
- Experience with Git and Azure DevOps
- Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
- Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)
Benefits
- Excellent career growth and promotional opportunities
- Stellar compensation
- Ability to work with the world's premier provider of aftermarket automotive data
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.