Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Senior Data Engineer responsible for designing, building, and deploying data solutions at CI&T. Collaborating on technical engagements and ensuring adherence to security best practices.
Responsibilities
- Contribute to technical engagements and proactively identify opportunities to expand CI&T's business with clients.
- Collaborate on multiple projects across various domains, providing diverse subject matter expertise.
- Participate in technical design and architecture discussions to ensure robust solutions.
- Ensure adherence to security and performance best practices in all solutions.
- Create and maintain technical documentation required by clients.
- Communicate effectively with customer team members to ensure alignment and clarity of technical solutions.
- Understand client requirements and develop viable technical solutions by selecting appropriate frameworks.
- Guarantee a stable and productive development environment for all team members.
Requirements
- 6+ years of experience in the software development area
- Proven expertise in Data Warehousing and Data Analytics projects, encompassing data acquisition, transformation, and data science initiatives.
- Exposure with modern data file formats such as Delta Tables, Apache Iceberg, and Parquet.
- Proficiency in Python, Spark, DBT, and other data transformation tools and frameworks.
- Expertise in data modelling, with familiarity in conceptual, logical, and physical data models, following methodologies like Data Vault 2.0 and Dimensional Modelling.
- Experience with cloud data services such as Microsoft Intelligent Data Platform, AWS Data Services, or Google Cloud Data Analytics.
- Minimum of 3 years experience with Snowflake
- Hands-on experience with cloud data platforms like Databricks and/or Snowflake; certifications.
- Skilled in data pipeline orchestration tools, including Azure Data Factory, AWS Glue, Apache Airflow, or Prefect.
- Experience with CI/CD and MLOps pipelines to streamline development and deployment processes.
- Proficient in Infrastructure as Code (IaC) for efficient infrastructure management.
- Expertise in data migration, performance tuning, and optimization of databases and SQL queries.
- Understanding of Data Governance and Data Management concepts.
- Understanding design patterns, clean architecture, and clean coding principles.
- Familiarity with unit, integration, and E2E testing.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.