Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Engineer specializing in Google Cloud Platform (GCP) focused on developing and optimizing data pipelines. Working with cross-functional teams and maintaining data integrity using GCP services.
Responsibilities
- Develop, implement, and optimize data engineering solutions (pipelines) on GCP infrastructure.
- Collect, clean, and pre-process data from various sources, ensuring data quality and integrity.
- Explore and analyze data to identify patterns, trends, and opportunities for improvement.
- Use GCP services and tools to build scalable and efficient data pipelines, including BigQuery, Cloud Storage, Dataflow, Dataproc, AI Platform, etc.
- Collaborate with cross-functional teams to ensure successful integration and deployment of data solutions.
- Stay up to date with the latest trends and technologies.
Requirements
- Bachelor's degree in Computer Science, Statistics, Mathematics, Economics, or a related field.
- 2 to 5 years of proven professional experience as a Data Engineer.
- Proficiency in programming languages such as Python and SQL.
- Hands-on experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Storage, Dataflow, and Dataproc.
- Pipeline orchestration using Rundeck;
- Ability to build and optimize data pipelines on GCP.
- Excellent communication skills and data visualization abilities.
- Ability to work independently and as part of a team.
- Strong problem-solving skills and analytical thinking.
- Intermediate to advanced English.
- Nice-to-haves:
- Google Cloud certifications.
- Experience with retail projects.
- Knowledge of data visualization tools such as Looker or Power BI.
- Experience with agile methodologies.
Benefits
- In our services portfolio we offer specialized consulting, staff augmentation, training, and development of custom solutions for Cloud Computing, Business Intelligence, Big Data, Data Analytics, Machine Learning, Artificial Intelligence, Data Quality, MDM, Data Governance, and other data solutions
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.