Lead Cloud Data Engineer managing data pipelines and implementations on cloud platforms in Financial Services. Collaborating for enhanced data architecture and team mentorship.
Responsibilities
Design, develop, and optimize end‑to‑end data pipelines using Databricks
Implement and manage Lakehouse architecture with Delta tables
Develop high‑performance PySpark and SQL transformations
Ensure data quality, integrity, and performance across pipelines
Lead troubleshooting, root cause analysis, and performance tuning
Collaborate with Architects, Business Analysts, and downstream consumers
Support CI/CD implementation for Databricks jobs and notebooks
Mentor junior engineers and review code for quality and best practices
Ensure adherence to security, governance, and compliance standards
Requirements
10-14 years of hands on experience with AWS Cloud Data Engineering with Databricks platform
Expertise in Data Modeling and DB design
Hands on experience in setting up data pipelines for ETL jobs across multiple data sources.
Hands‑on experience with performance tuning, Git, Jenkins, and enterprise job scheduling tools (Autosys / Airflow)
Basic understanding of Data warehousing and ETL concepts
Data Engineering Enablement Consultant role facilitating data engineering inquiries and support for GM's data platforms. Partnering with technical teams to optimize processes and enhance customer experience.
Data Engineer focused on building scalable data architecture for analytics at ZEISS. Collaborating with teams to ensure data quality and compliance in a modern data environment.
Lead SAP Data Engineer overseeing data integration activities at Equitable. Collaborating with finance team to automate processes and enhance analytics.
Data Engineer focusing on real - time data platform development to support pricing algorithms for Trumid. Collaborating with quantitative researchers and engineers in a dynamic fintech environment.
Senior Data Engineer building scalable analytics platform in BigQuery for Trumid's fintech services. Focus on data modeling and governance to support analytics and reporting needs.
Software Engineer III at GHX working on Content Tooling with focus on data engineering and analytics. Collaborating in Agile environment to create and support data - intensive software solutions.
Consultant supporting the delivery of SAP Data Migration solutions across the region. Engaging in client workshops, analyzing data, and advising on migration best practices.
Data Engineer contributing to data pipeline development and GenAI experiments at a technology consulting firm. Collaborating on data visualization, automation, and documentation efforts for data projects.
Data Engineer analyzing datasets using SQL and Python, working closely with clients in a hybrid setup. Performing data analysis and collaborating with cross - functional teams.