Data Engineer developing scalable data products and pipelines for General Motors' advanced analytics. Collaborating with cross-functional teams to ensure robust data systems and predictive insights.
Responsibilities
Architect and build scalable data pipelines and services using Databricks, Spark, and Azure to support advanced analytics and machine learning workflows.
Design and implement industrial-grade data products that ingest, transform, and serve vehicle, battery, and environmental data for product health monitoring.
Collaborate with cross-functional teams to define data requirements and deliver solutions that meet business and technical needs.
Ensure data quality, integrity, and governance across all stages of the data lifecycle.
Optimize performance of data systems and pipelines to support real-time and batch processing.
Develop and maintain documentation, testing frameworks, and CI/CD pipelines for data engineering workflows.
Demonstrate proficiency in Python through hands-on coding, peer reviews, and technical interviews.
Support the integration of new data sources and technologies into the platform, ensuring scalability and maintainability.
Requirements
Master’s degree in Software Engineering, Computer Science, Information Technology, or related field.
5+ years of experience in data engineering, software development, or building data-intensive applications.
Proficiency with Databricks, Spark, SQL, and Python.
Experience designing and deploying data pipelines in cloud environments (preferably Azure).
Strong understanding of distributed systems, data modeling, and ETL best practices.
Ability to translate ambiguous business problems into scalable data solutions.
Excellent communication and collaboration skills.
Demonstrated ability to work in a fast-paced, cross-functional environment.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.
Boomi Integration Architect designing and leading integration solutions for data warehouses. Collaborating with cross - functional teams to implement scalable integration patterns using Boomi technologies.
Seeking a Boomi Integration Architect specializing in Data Warehouse and Master Data Hub implementations. Responsible for designing high - performance integration solutions across enterprise platforms.
Principal Data Engineer at Serko enhancing global travel tech through data - driven solutions. Collaborating across teams in Bengaluru to drive innovative engineering and best practices.
Data Engineer at Keyrus responsible for building and optimizing data pipelines for major projects. Contributing to data solutions and ensuring data quality in a growing team.
Data Architect designing and implementing scalable data architectures for Keyrus in Bordeaux. Leading client transitions and contributing to the tech ecosystem with innovative data solutions.