Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
About the role
- Data Engineer developing scalable data products and pipelines for General Motors' advanced analytics. Collaborating with cross-functional teams to ensure robust data systems and predictive insights.
Responsibilities
- Architect and build scalable data pipelines and services using Databricks, Spark, and Azure to support advanced analytics and machine learning workflows.
- Design and implement industrial-grade data products that ingest, transform, and serve vehicle, battery, and environmental data for product health monitoring.
- Collaborate with cross-functional teams to define data requirements and deliver solutions that meet business and technical needs.
- Ensure data quality, integrity, and governance across all stages of the data lifecycle.
- Optimize performance of data systems and pipelines to support real-time and batch processing.
- Develop and maintain documentation, testing frameworks, and CI/CD pipelines for data engineering workflows.
- Demonstrate proficiency in Python through hands-on coding, peer reviews, and technical interviews.
- Support the integration of new data sources and technologies into the platform, ensuring scalability and maintainability.
Requirements
- Master’s degree in Software Engineering, Computer Science, Information Technology, or related field.
- 5+ years of experience in data engineering, software development, or building data-intensive applications.
- Proficiency with Databricks, Spark, SQL, and Python.
- Experience designing and deploying data pipelines in cloud environments (preferably Azure).
- Strong understanding of distributed systems, data modeling, and ETL best practices.
- Ability to translate ambiguous business problems into scalable data solutions.
- Excellent communication and collaboration skills.
- Demonstrated ability to work in a fast-paced, cross-functional environment.
Benefits
- Relocation benefits may be available
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Data Engineer focusing on secure ETL/ELT data pipelines and compliance in healthcare. Designing scalable ingestion frameworks and ensuring alignment with federal standards.