Data Engineer managing reliable data pipelines and solutions using Microsoft Azure and Python. Collaborating across teams to meet business data needs in a scalable environment.
Responsibilities
Data Engineering & Development
Design, build, and maintain reliable, scalable data pipelines using batch and incremental processing patterns.
Develop and optimise SQL-based transformations and data models for analytics and reporting use cases.
Write clean, efficient and testable code using Python (Pandas / PySpark).
Implement and support data warehouse and lakehouse solutions following best practices (e.g., Bronze/Silver/Gold).
Build curated datasets and semantic models to enable Power BI dashboards and reports.
Cloud & Platform
Work extensively on the Microsoft Azure data ecosystem, including:
Azure Synapse Analytics
Azure Databricks
Azure Data Factory (ADF)
Azure Data Lake (ADLS Gen2)
Power BI
Participate in design and implementation of solutions on Microsoft Fabric (nice to have).
Support workloads running on or integrated with AWS and GCP where required.
Operational Excellence
Ensure data pipelines are robust, monitored, and production-ready.
Troubleshoot and resolve data quality, performance, and reliability issues.
Support production systems and participate in incident resolution and root-cause analysis.
Apply FinOps principles to optimize cloud data platform costs.
Collaboration & Leadership
Act as a technical mentor for junior and mid-level data engineers.
Review code and designs with a focus on quality, performance, and maintainability.
Work closely with analysts, product owners, and stakeholders to understand real business requirements and translate them into data solutions.
Contribute positively to team culture with a collaborative and ownership-driven mindset.
Requirements
6-9 years of experience in data engineering, analytics engineering, or software engineering.
5+ years of strong hands-on experience with:
SQL (complex queries, performance tuning, data modeling)
Data Warehousing concepts
Data visualization using Power BI
Strong programming experience with Python, especially Pandas (PySpark experience is a plus).
Proven experience building and supporting data platforms on Microsoft Azure.
Strong analytical skills and ability to represent data meaningfully by understanding business context.
Good to Have
Exposure to Microsoft Fabric.
Basic working knowledge of:
Bash / Shell scripting
Networking fundamentals
Infrastructure as Code (Terraform)
IAM and security concepts
Familiarity with data governance concepts such as data quality, lineage, and access control.
What We Look For
A strong hands-on senior engineer, not just a designer.
Someone who takes ownership of data solutions end-to-end.
A team player with good cultural adaptability and communication skills.
Curiosity and passion for continuously improving data systems.
Engenheiro de Dados especializado em PowerBI e Lakehouse no Campos Thomaz Advogados. Foco em preparar dados para dashboards e estruturação de ambientes com Microsoft.
Data Platform Expert developing and maintaining data solutions for analysis and reporting at Magna Electronics. Collaborating with various teams to enhance data - driven decision making and insights.
Data Engineer at Mobiz designing, building, and maintaining scalable data solutions for analytics. Collaborating with teams to leverage modern cloud technologies and improve data - driven decision - making.
Head of Data Engineering at Envitia overseeing data architecture services for public sector programs. Leading service mobilization with client stakeholders in a hybrid work environment.
Applied AI Health Data Architect - Senior Manager at PwC designing data architecture for healthcare operations. Contributing to innovative data solutions and mentoring teams for operational excellence.
CRM Functional Data Migration Engineer at Data - Core Systems, Inc. managing Dynamics 365 CE solutions and delivering technical expertise in a consulting role.
Data Engineer role for Alberta Securities Commission, focusing on data pipelines and infrastructure. Involves designing, building, and securing data assets for organizational decision - making.
Data Architect supporting UK MOD programme delivering data and integration capabilities for Defence. Join Amentum's growing IT team focused on critical national infrastructure and security projects.
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.