Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
About the role
- Senior Data Engineer responsible for designing and implementing ETL pipelines. Collaborating with cross-functional teams to ensure data quality and optimizing data workflows with AWS tools.
Responsibilities
- Design and implement robust ETL pipelines using AWS Glue, Lambda, and S3.
- Monitor and optimize the performance of data workflows and batch processing jobs.
- Troubleshoot and resolve issues related to data pipeline failures, inconsistencies, and performance bottlenecks.
- Collaborate with cross-functional teams to define data requirements and ensure data quality and accuracy.
- Develop and maintain automated solutions for data transformation, migration, and integration tasks.
- Implement best practices for data security, data governance, and compliance within AWS environments.
- Continuously improve and optimize AWS Glue jobs, Lambda functions, and S3 storage management.
- Maintain comprehensive documentation for data pipeline architecture, job schedules, and issue resolution processes.
Requirements
- Strong experience with Data Engineering practices.
- Experience in AWS services, particularly AWS Glue, Lambda, S3, and other AWS data tools.
- Proficiency in SQL, python , Pyspark, numpy etc and experience in working with large-scale data sets.
- Experience in designing and implementing ETL pipelines in cloud environments.
- Expertise in troubleshooting and optimizing data processing workflows.
- Familiarity with data warehousing concepts and cloud-native data architecture.
- Knowledge of automation and orchestration tools in a cloud-based environment.
- Strong problem-solving skills and the ability to debug and improve the performance of data jobs.
- Excellent communication skills and the ability to work collaboratively with cross-functional teams.
- Good to have knowledge of DBT & Snowflake
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.