Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Lead Data Engineer shaping enterprise data platform at Ness Digital Engineering. Designing data solutions, optimizing performance, and mentoring engineering teams in financial services domain.
Responsibilities
- Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps
- Design and implement data models, pipelines, and data integration frameworks across multiple platforms
- Partner with stakeholders to translate business requirements into scalable data solutions
- Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake
- Drive adoption of best practices in data engineering design patterns and modern cloud architectures
- Implement and monitor data validation procedures to ensure data accuracy and consistency across systems
- Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals
- Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes
- Ensure compliance with data governance, security, and privacy standards
- Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic
- Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or a related field
- 8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development
- Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization
- Proficiency in SQL and familiarity with data integration and ETL/ELT tools
- AWS Technologies (Glue, EMR)
- Python for data engineering workflows
- Strong understanding of data engineering design patterns
- Strong problem-solving skills and the ability to work independently to meet deadlines
- Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Benefits
- Flexible remote options
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.