Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Engineer focusing on scalable data pipelines for analysis and visualization. Join CI&T, a tech transformation expert, with diverse client partnerships over 30 years.
Responsibilities
- Design, develop and maintain scalable data pipelines to support data analysis and visualization.
- Collaborate with cross-functional teams to ensure data integrity and usability.
- Integrate and optimize data quality across all pipelines.
- Implement and work with Data Lake and Data Warehouse solutions, ensuring data modeling best practices.
- Participate in data governance rituals, such as PDCA and risk management, to ensure data quality and integrity.
- Define and monitor Non-Functional Requirements (NFRs) related to data quality and performance.
- Communicate and align technical solutions with the client team, ensuring that all requirements are met.
- Act as a trusted advisor to the client and internal team in the implementation of data-related technologies and processes.
- Propose and implement innovative solutions to technical data challenges, ensuring a stable and productive development environment.
Requirements
- Experience with Databricks (Spark, PySpark) and PowerCenter.
- Solid experience in Data Warehouse and Data Lake, with knowledge of best practices in data modeling and data governance.
- Experience with Azure services such as Data Factory, focusing on data integration and orchestration.
- Strong understanding of data quality, data pipelines and DataOps practices.
- Familiarity with DataOps environments, including continuous integration and delivery (Git, SCM).
- Ability to mobilize teams and communicate effectively to resolve problems and impediments.
- Capability to create and manage the project's technical roadmap, including technical dependencies and change management.
- Competence in orchestrating and integrating solutions, taking into account trade-offs and technical metrics.
Benefits
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass
- Profit Sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to physical and mental health and well-being
- Pregnancy and responsible parenting course
- Partnerships with online course platforms
- Language learning platform
- And many others
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.