Senior Lead Data Engineer in Bangalore, Karnataka, India designing and building AWS data engineering solutions. Leading teams on scalable data pipelines using Spark, PySpark, and Python.
Responsibilities
Design, develop, and implement data engineering solutions on AWS cloud
Build scalable data pipelines using Spark, PySpark, and Python
Ensure data quality, integrity, and performance optimization across data pipelines
Collaborate with data architects and business stakeholders
Provide technical leadership and mentorship to data engineers
Requirements
Overall 8+ years of experience
Lead the design, development, and implementation of data engineering solutions on AWS cloud
Architect and build scalable data pipelines using Spark, PySpark, and Python
Design and implement data lakes and data warehouse solutions to support analytics and reporting needs
Develop optimized SQL queries and transformations for large-scale data processing
Create and maintain data models (dimensional and normalized) to support business intelligence and analytics use cases
Ensure data quality, integrity, and performance optimization across data pipelines
Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable data solutions
Provide technical leadership and mentorship to data engineers
Drive best practices in coding standards, data governance, and performance tuning
Participate in architecture discussions, design reviews, and project planning
Ensure timely delivery of data engineering solutions
Data Engineer at Pruna AI merging data engineering, analytics engineering, and revenue operations. Working on intelligent automation and analytics for accessible and sustainable AI.
Data Engineer developing modern cloud - based data pipelines at UK Biobank for research support. Collaborating within the Data & Technology team to create clean, scalable, secure code.
Senior Consultant SAP Data Migration leading projects in data migration for various clients. Collaborating with project teams to ensure successful strategy implementation and data quality management.
Data Engineering Team Lead engaging with enterprise - level organizations on data architecture using Google Cloud solutions. Leading a team of data engineers in a hybrid work model.
Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.
Senior Data Engineer at Skillfield designing distributed data processing solutions using Apache Spark. Collaborates on cloud and on - prem solutions across enterprise levels in a hybrid work environment.
Senior Data Engineer optimizing ETL/ELT pipelines at Asahi Kasei. Evaluate programming concepts and support data science projects while ensuring solution stability in a hybrid work setup.
Data Engineer responsible for building data intelligence system for the public sector. Ensuring data ingestion, quality, correlation, and helping with analytics for decision making.