Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
About the role
- Data Engineer responsible for developing scalable data solutions and optimizing pipelines at Mindera. Collaborating with stakeholders to ensure data quality and performance in Chennai, India.
Responsibilities
- Design, develop, and maintain scalable **data pipelines** and transformation workflows using Databricks and Spark.
- Build and optimize **ETL/ELT processes** to ingest, cleanse, and prepare large datasets.
- Work with AWS services such as **S3, Lambda, IAM, ECS and CloudWatch** to support data architecture and operational needs.
- Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
- Ensure data quality, reliability, and performance across all data systems.
- Implement and enforce **best practices** for coding, version control, CI/CD, and environment management.
- Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
- Contribute to architectural decisions, documentation, and process improvements.
Requirements
- Strong hands-on experience with **AWS Cloud** (S3, Lambda, IAM, EC2 or equivalent).
- Extensive experience with **Databricks**, Delta Lake, and Unity Catalog.
- Proficiency in **Apache Spark** (PySpark preferred).
- Strong programming skills in **Python**.
- Excellent command of **SQL**, including performance tuning and working with large datasets.
- Experience working in fast-paced, agile environments.
- Strong problem-solving abilities and a proactive approach to identifying improvements.
- Excellent communication and stakeholder management skills; able to collaborate across multiple teams.
- Experience with data governance frameworks and tools (e.g., DataHub, Soda).
- Experience with CI/CD tools (GitHub Actions).
Benefits
- Fun, happy and politics-free work culture built on the principles of lean and self organisation;
- Work with large scale systems powering global businesses;
- Competitive salary and benefits.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.