Transforming business strategies into high-performance solutions using Databricks. Leading data engineering, advanced analytics, and generative AI initiatives in a scalable architecture.
Responsibilities
Lakehouse Architecture: Design and evolve the enterprise platform on Databricks (Delta Lake), establishing ingestion patterns (batch/streaming), storage, and consumption standards.
Governance & Security: Implement governance frameworks using Unity Catalog, ensuring data quality, lineage, security (RBAC/ABAC), and compliance with the LGPD (Brazilian Data Protection Law).
AI & ML Support: Design infrastructure for the Machine Learning lifecycle (MLOps) and GenAI initiatives, supporting everything from feature engineering to LLM deployment.
Data Engineering: Define technical standards for complex pipelines, integrating critical systems such as SAP (S/4HANA) and legacy databases.
Technical Leadership: Act as an advisor for executive decisions and guide engineering teams in applying best practices for versioning and resilience.
Requirements
Proven track record as a Data Architect in complex environments.
Strong command of the Databricks ecosystem (Unity Catalog, Delta Lake, Jobs, Workflows).
Advanced experience with Azure Cloud.
Expertise in data modeling and high-performance SQL.
Clear understanding of scalable pipelines and governance/security patterns.
Ability to translate complex business needs into clear technical diagrams.
Comfortable collaborating across Security, Infrastructure, and Business teams.
Pragmatic innovation mindset: focused on continuous improvement with an emphasis on delivering organizational value.
Preferred qualifications:
Knowledge of MLOps (MLflow, monitoring, and retraining).
Experience with Data Mesh and domain-oriented architectures.
Experience in the Energy or Oil & Gas sectors.
Familiarity with SAP technologies (S/4HANA, Datasphere).
Benefits
Health and dental insurance
Meal and grocery allowance
Childcare allowance
Extended parental leave
Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass
Profit Sharing (PLR)
Life insurance
Continuous learning platform (CI&T University)
Discount club
Free online platform dedicated to promoting physical and mental health and wellbeing
Data Management professional at Kyndryl involved in creating innovative data solutions and ensuring the seamless operation of complex data systems. Collaborating with teams to transform requirements into scalable database solutions.
Software Engineer designing and developing scalable data processing applications on cloud infrastructure for Thomson Reuters. Collaborating with Data Analysts on AI - enabled solutions for data management and insight generation.
Manager of Data Platform overseeing AWS cloud infrastructure and Snowflake data warehouses for Thomson Reuters. Leading the design and implementation of data processing applications in a hybrid role located in Bengaluru.
Senior Data Engineer designing scalable data pipelines and solutions for Enterprise Data Lake at Thomson Reuters. Collaborating across teams to ensure efficient data ingestion and accessibility.
Senior Data Engineer at Technis developing scalable data pipelines and solutions for innovative connected spaces products. Collaborating within a cross - functional team to deliver high - quality data - driven outcomes.
Data Architect designing and implementing data architectures supporting analytics and ML for federal clients. Collaborating with teams to translate mission needs into robust data solutions.
IT Data Engineer developing data pipelines and integrations for Scanfil Group's global IT organization. Collaborating across teams to enhance data solutions and reporting capabilities.
Data Engineer developing Azure data solutions at PwC New Zealand. Responsibilities include data quality monitoring, pipeline development, and collaboration with stakeholders in a supportive environment.
Senior Data Engineer designing and implementing the Enterprise Data Platform at Stellix. Focusing on analytics and insights with a growth path to Principal Data Engineer or Data Architect.