Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Engineer deploying Azure Databricks solutions at EY, leading a team and optimizing data models. Collaborating with clients to meet business needs in a cloud environment.
Responsibilities
- Develop & deploy Azure Databricks in a cloud environment using Azure Cloud services.
- ETL design, development, and deployment to Cloud Service.
- Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams.
- Design and optimize model codes for faster execution.
- Lead and mentor a team of data engineers and analysts, ensuring high-quality delivery and fostering professional growth.
- Collaborate with cross-functional teams to manage project timelines and deliverables.
Requirements
- 9 to 14 years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
- Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Data Catalog, Cosmos DB, etc.
- Familiar with cloud services like Azure.
- Hands-on experience on Spark/PySpark.
- Hands-on experience in programming languages such as Python/Scala.
- Knowledge in DevOps and CI/CD deployments.
- Must have hands-on experience in SQL and procedural SQL languages.
- Strong analytical skills and enjoys solving complex technical problems.
- Proven ability to lead teams, manage resources, and drive projects to successful completion.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.