Lead Data Engineer shaping enterprise data platform at Ness Digital Engineering. Designing data solutions, optimizing performance, and mentoring engineering teams in financial services domain.
Responsibilities
Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps
Design and implement data models, pipelines, and data integration frameworks across multiple platforms
Partner with stakeholders to translate business requirements into scalable data solutions
Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake
Drive adoption of best practices in data engineering design patterns and modern cloud architectures
Implement and monitor data validation procedures to ensure data accuracy and consistency across systems
Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals
Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes
Ensure compliance with data governance, security, and privacy standards
Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic
Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Requirements
Bachelor’s degree in Computer Science, Information Technology, or a related field
8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development
Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization
Proficiency in SQL and familiarity with data integration and ETL/ELT tools
AWS Technologies (Glue, EMR)
Python for data engineering workflows
Strong understanding of data engineering design patterns
Strong problem-solving skills and the ability to work independently to meet deadlines
Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.