Transforming business strategies into high-performance solutions using Databricks. Leading data engineering, advanced analytics, and generative AI initiatives in a scalable architecture.
Responsibilities
Lakehouse Architecture: Design and evolve the enterprise platform on Databricks (Delta Lake), establishing ingestion patterns (batch/streaming), storage, and consumption standards.
Governance & Security: Implement governance frameworks using Unity Catalog, ensuring data quality, lineage, security (RBAC/ABAC), and compliance with the LGPD (Brazilian Data Protection Law).
AI & ML Support: Design infrastructure for the Machine Learning lifecycle (MLOps) and GenAI initiatives, supporting everything from feature engineering to LLM deployment.
Data Engineering: Define technical standards for complex pipelines, integrating critical systems such as SAP (S/4HANA) and legacy databases.
Technical Leadership: Act as an advisor for executive decisions and guide engineering teams in applying best practices for versioning and resilience.
Requirements
Proven track record as a Data Architect in complex environments.
Strong command of the Databricks ecosystem (Unity Catalog, Delta Lake, Jobs, Workflows).
Advanced experience with Azure Cloud.
Expertise in data modeling and high-performance SQL.
Clear understanding of scalable pipelines and governance/security patterns.
Ability to translate complex business needs into clear technical diagrams.
Comfortable collaborating across Security, Infrastructure, and Business teams.
Pragmatic innovation mindset: focused on continuous improvement with an emphasis on delivering organizational value.
Preferred qualifications:
Knowledge of MLOps (MLflow, monitoring, and retraining).
Experience with Data Mesh and domain-oriented architectures.
Experience in the Energy or Oil & Gas sectors.
Familiarity with SAP technologies (S/4HANA, Datasphere).
Benefits
Health and dental insurance
Meal and grocery allowance
Childcare allowance
Extended parental leave
Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass
Profit Sharing (PLR)
Life insurance
Continuous learning platform (CI&T University)
Discount club
Free online platform dedicated to promoting physical and mental health and wellbeing
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.