Data Engineer building scalable cloud data pipelines in Azure and Databricks. Focus on Lakehouse architecture and data governance in a hybrid work model.
Responsibilities
Design and develop scalable, robust data ingestion and transformation pipelines on Azure and Databricks;
Build solutions based on Lakehouse architecture, organized into bronze, silver and gold layers;
Ensure pipeline performance and scalability through best practices in partitioning, caching and parallelism;
Automate processes with a focus on reusability, monitoring and quality control;
Act as a technical reference for the data engineering team, promoting best practices and standardization.
Requirements
Experience with transactional databases and requirements analysis;
Knowledge of Data Governance;
Strong familiarity with Azure Data Lake Gen2, Azure Data Factory, Key Vault and integration across Azure services;
Proficiency in Spark (PySpark) and Python for developing pipelines and transforming data;
Experience with Git and CI/CD practices applied to data pipelines;
Advanced conversational English.
Benefits
Multi-benefits card – choose how and where to use it.
Scholarships for undergraduate, graduate, MBA and language courses.
Certification incentive programs.
Flexible working hours.
Competitive salaries.
Annual performance review with a structured career plan.
Possibility of international career opportunities.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.