AWS Data Engineer working in Gurugram to support data architecture and integration solutions. Collaborating and translating business needs into data models.
About the role
- Data Engineer at LPL Financial developing Python-based ETL pipelines. Collaborating with cross-functional teams to ensure reliable data delivery and optimizing pipeline performance.
Responsibilities
- Design, build, and maintain Python Flask ETL microservices and automated data pipelines
- Develop, schedule, and monitor workflows using Apache Airflow
- Implement data ingestion from diverse sources, including Snowflake, flat files, cloud storage, and public APIs
- Partner with analytics and business teams to understand data requirements and deliver reliable, well-structured datasets
- Optimize pipeline performance, ensure data quality, and support production stability
- Contribute to DevOps best practices, including CI/CD workflows, testing, logging, and observability
- Document processes, data flows, and system dependencies for operational clarity
Requirements
- 3+ years of experience designing and building ETL processes in Python
- Demonstrable hands-on experience with: Apache Airflow for workflow orchestration
- Integrating data from Snowflake, flat files, and REST/JSON public APIs
- SQL, data modeling, and production data engineering practices
- Ability to collaborate effectively across distributed teams; quarterly travel is required
Benefits
- 401K matching
- health benefits
- employee stock options
- paid time off
- volunteer time off
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer handling data engineering responsibilities in hybrid setting for banking industry. Collaborating with cross - functional teams and maintaining data quality in Azure environments.
Data Management professional at Kyndryl involved in creating innovative data solutions and ensuring the seamless operation of complex data systems. Collaborating with teams to transform requirements into scalable database solutions.
Software Engineer designing and developing scalable data processing applications on cloud infrastructure for Thomson Reuters. Collaborating with Data Analysts on AI - enabled solutions for data management and insight generation.
Manager of Data Platform overseeing AWS cloud infrastructure and Snowflake data warehouses for Thomson Reuters. Leading the design and implementation of data processing applications in a hybrid role located in Bengaluru.
Senior Data Engineer designing scalable data pipelines and solutions for Enterprise Data Lake at Thomson Reuters. Collaborating across teams to ensure efficient data ingestion and accessibility.
Senior Data Engineer at Technis developing scalable data pipelines and solutions for innovative connected spaces products. Collaborating within a cross - functional team to deliver high - quality data - driven outcomes.
Architect leading initiatives in data platform engineering at F5, solving challenges in unstructured data and enhancing governance frameworks.
Data Architect designing and implementing data architectures supporting analytics and ML for federal clients. Collaborating with teams to translate mission needs into robust data solutions.
IT Data Engineer developing data pipelines and integrations for Scanfil Group's global IT organization. Collaborating across teams to enhance data solutions and reporting capabilities.