Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
About the role
- Senior Data Engineer responsible for designing and implementing ETL pipelines. Collaborating with cross-functional teams to ensure data quality and optimizing data workflows with AWS tools.
Responsibilities
- Design and implement robust ETL pipelines using AWS Glue, Lambda, and S3.
- Monitor and optimize the performance of data workflows and batch processing jobs.
- Troubleshoot and resolve issues related to data pipeline failures, inconsistencies, and performance bottlenecks.
- Collaborate with cross-functional teams to define data requirements and ensure data quality and accuracy.
- Develop and maintain automated solutions for data transformation, migration, and integration tasks.
- Implement best practices for data security, data governance, and compliance within AWS environments.
- Continuously improve and optimize AWS Glue jobs, Lambda functions, and S3 storage management.
- Maintain comprehensive documentation for data pipeline architecture, job schedules, and issue resolution processes.
Requirements
- Strong experience with Data Engineering practices.
- Experience in AWS services, particularly AWS Glue, Lambda, S3, and other AWS data tools.
- Proficiency in SQL, python , Pyspark, numpy etc and experience in working with large-scale data sets.
- Experience in designing and implementing ETL pipelines in cloud environments.
- Expertise in troubleshooting and optimizing data processing workflows.
- Familiarity with data warehousing concepts and cloud-native data architecture.
- Knowledge of automation and orchestration tools in a cloud-based environment.
- Strong problem-solving skills and the ability to debug and improve the performance of data jobs.
- Excellent communication skills and the ability to work collaboratively with cross-functional teams.
- Good to have knowledge of DBT & Snowflake
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.