Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Engineer II designing and building data pipelines for analytics at Honeywell. Collaborating with data scientists and product owners in a hybrid work setting in Charlotte, NC.
Responsibilities
- Design & build pipelines to ingest, transform, and publish structured/unstructured data from SFDC, EDW, ADLS, Event Hub, and APIs into Databricks/Snowflake, following Delta Lake and Unity Catalog standards
- Model data (star/snowflake, CDC, SCD, dimensional views) to support analytics (e.g., commercial pipeline metrics, quote/discount modeling)
- Operationalize ML/analytics pipelines including bronze→silver→gold processing, joins with model/market indicators, and serving outputs to applications/APIs
- Harden platforms: CI/CD with Azure DevOps; monitor jobs/clusters; optimize PySpark/SQL performance; enforce data governance (quality, privacy, lineage, access)
- Partner & document: collaborate with product owners and data science; write runbooks and technical specs; contribute to weekly updates and stewardship forums
Requirements
- Min 4 years of experience in data engineering, ETL, or database development/administration
- Hands‑on Azure Databricks, CI/CD & DevOps, and Snowflake experience
- Strong Python, SQL, PySpark; comfort with both structured and unstructured data
- Experience with Agile delivery
- Bachelor’s degree in a technical discipline such as science, technology, engineering, mathematics
- Experience with at least one NoSQL store (e.g., HBase/Cassandra/MongoDB)
- Familiarity with Hadoop ecosystem (HDFS, Spark), and data integration/ETL tools
- Exposure to ML ops tooling (MLflow), AKS‑backed API services, and integration patterns between Databricks, Snowflake, and application layers
- Demonstrated contributions to data quality/stewardship initiatives (lineage, metadata, GDM frameworks)
- Clear communication and ability to present technical trade‑offs to stakeholders
- Working knowledge of SFDC data model and commercial processes (opportunities, quotes, quote line items)
Benefits
- Comprehensive benefits package including employer-subsidized Medical, Dental, Vision, and Life Insurance
- Short-Term and Long-Term Disability
- 401(k) match
- Flexible Spending Accounts
- Health Savings Accounts
- EAP
- Educational Assistance
- Parental Leave
- Paid Time Off (for vacation, personal business, sick time, and parental leave)
- 12 Paid Holidays
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.