Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Architect specializing in Azure and Databricks technologies at Ness Digital Engineering. Leading the design and implementation of enterprise-scale data solutions.
Responsibilities
- Lead the architecture, design, and implementation of enterprise data warehouses, data lakes, and lakehouses on Azure and Databricks
- Define and enforce data modeling standards, best practices, and guidelines
- Architect end-to-end modern data platforms leveraging Azure Synapse, Databricks, Delta Lake
- Design scalable ETL/ELT pipelines and orchestrate workflows for ingestion, transformation, and consumption
- Partner with business stakeholders, product teams, and data engineers to deliver high-quality data solutions
- Ensure solutions are secure, performant, and compliant with enterprise governance and regulatory standards
- Define data strategy and reference architecture for modernization from legacy to modern architectures
- Provide technical leadership and mentoring to engineering teams
Requirements
- 15+ years of experience in Data Engineering/Architecture
- Proven experience as a Data Architect or Senior Data Engineer/Lead designing and implementing enterprise data warehouses
- Hands-on expertise with Azure services: Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Azure Purview
- Strong expertise with Databricks: Delta Lake, Lakehouse, Spark, MLflow
- Very strong SQL development and optimization skills
- Strong data modeling skills
- Knowledge of traditional data platforms
- Solid understanding of data governance, metadata management, data quality, and security
- Experience in building real-time/streaming data pipelines is a plus
- Bachelor’s/Master’s degree in Computer Science, Information Systems, or related field
- Certifications in Azure Data Engineer/Architect or Databricks preferred.
Benefits
- Flexible work arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.