Manager, Data Engineering leading the cloud - native data engineering vision at Grainger. Developing scalable platforms and mentoring data engineers to enhance quality and business impact.
About the role
- Engineer focusing on data engineering in Google Cloud Platform. Developing and maintaining data pipelines with governance on information quality.
Responsibilities
- Desenvolver e manter **pipelines de dados** utilizando **Dataflow, Cloud Composer e BigQuery**.
- Estruturar e organizar dados em arquitetura de **Data Lake** baseada no modelo **medalhão (Bronze, Silver, Gold)**.
- Apoiar a implementação e administração de **catálogo e governança** de dados com **DataPlex**.
- Criar e otimizar consultas em **BigQuery** (e SQL quando necessário).
- Trabalhar em conjunto com arquitetura e times de dados para definir **padrões, automações e boas práticas**.
- Garantir **observabilidade, segurança e qualidade** nas integrações e cargas de dados.
Requirements
- Experiência com **Google Cloud Platform (GCP)**, incluindo: **BigQuery, Composer, Dataflow, DataPlex, Data Lake e Dataform**.
- Domínio de **SQL** e **modelagem de dados analíticos** (BigQuery SQL e/ou SQL Server).
- Experiência com processos **ETL/ELT** e arquitetura **medalhão**.
- Conhecimento em **Python** para automação e orquestração de pipelines.
- Familiaridade com **Git** e práticas de **CI/CD**.
- **Desejáveis:** Conhecimento em ecossistema **AWS** (ex.: Glue, Redshift) e integrações **multicloud**.
- Experiência com **IaC** (Terraform/CloudFormation).
- Vivência em **DevSecOps, DataOps** e projetos de **migração/integração entre clouds**.
Benefits
- Vale Alimentação e/ou Vale Refeição
- Convênio Sesi e Sesc, oferecendo acesso a serviços de saúde, bem-estar e lazer
- Parceria com Instituições de Ensino, com descontos exclusivos em cursos e programas educacionais
- Possibilidade de crescimento na empresa e de participação em projetos estratégicos
- Oportunidade de trabalhar em uma empresa do mercado em plena expansão.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Big Data Engineer optimizing scalable data solutions using Hadoop, PySpark, and Hive at Citi. Responsible for building ETL pipelines and ensuring data quality in a hybrid work environment.
Senior Data Engineer in Data Ingestion team at Novo Nordisk, designing scalable data solutions for analytics, AI, and research. Building robust applications and pipelines to support operational use cases.
Data Engineer delivering data for Financial Crime Prevention teams and supporting consistent data layer. Collaborating with multiple teams and defining expected solution details.
Senior consultant at Infosys designing enterprise data solutions and leading technical teams. Collaborating across business pillars in a high - growth consulting environment focused on analytics and data strategy.
Data Engineer I developing data services with Azure technology for global risk management insights. Collaborating with teams to optimize data processes and ensure quality standards.
Senior Data Engineer designing and overseeing data pipelines in Databricks on AWS. Responsible for data quality and performance for enterprise analytics and AI workloads.
Data Engineer responsible for developing ETL/ELT pipelines for Whow Games. Work includes optimizing data models and managing databases for analysis.
Global digital business services organization seeks Data Engineer to enhance data processes through innovative solutions and collaboration.
AI Data Pipeline Engineer designing and operating high - throughput systems for petabyte - scale data delivery. Collaborating across teams to ensure data flows into AI workloads efficiently.