Data Engineer responsible for developing ETL pipelines and ensuring data solutions in AWS data lakes/warehouses. Collaborating with teams and focusing on data quality, compliance, and performance optimization.
Responsibilities
Design, develop, and maintain ETL pipelines using AWS Glue, Glue Studio, and Glue Catalog.
Ingest, transform, and load large datasets from structured and unstructured sources into AWS data lakes/warehouses.
Work with S3, Redshift, Athena, Lambda, and Step Functions for data storage, query, and orchestration.
Build and optimize PySpark/Scala scripts within AWS Glue for complex transformations.
Implement data quality checks, lineage, and monitoring across pipelines.
Collaborate with business analysts, data scientists, and product teams to deliver reliable data solutions.
Ensure compliance with data security, governance, and regulatory requirements (BFSI preferred).
Troubleshoot production issues and optimize pipeline performance.
Requirements
9+ years of experience in Data Engineering, with at least 5+ years on AWS cloud data services.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.
Data Engineer at Tatum focusing on scalable data solutions and blockchain technology. Collaborating with teams to ensure data integrity and manage data infrastructure in a hybrid setup.