Hybrid Azure Data Engineer

Posted 1 hour ago

Apply now

About the role

  • Azure Data Engineer developing scalable data pipelines and collaborating with data teams for EU institutions. Working remotely from EU locations with a focus on high-quality data management.

Responsibilities

  • Develop, deploy, and maintain scalable and incremental data pipelines from REST APIs and databases using Python, PySpark, Azure Synapse, Knime, SQL, and ETL tools to ingest, transform, and prepare data.
  • Process and transform complex JSON and GIS data into structured datasets optimized for analysis and reporting.
  • Load, organize, and manage data in Azure Data Lake Storage and Microsoft Fabric OneLake, ensuring accessibility, performance, and efficient storage using lakehouse and Delta Lake patterns.
  • Document ETL processes, metadata definitions, data lineage, and technical specifications to ensure transparency and reusability.
  • Collaborate with data analysts, BI developers, and business stakeholders to understand data requirements and deliver reliable, well-documented datasets aligned with organizational needs.
  • Implement data quality checks, logging, monitoring, and automated incremental load mechanisms within data pipelines to support maintainability, observability, and troubleshooting.

Requirements

  • Bachelor degree - EQF 6
  • Ability to understand, speak and write English (C1/C2), French (B2) will be an advantage
  • Excellent knowledge of data engineering tools Azure Synapse Analytics, Microsoft Fabric, PySpark and Python.
  • Excellent knowledge of working with REST APIs, including ingestion and parsing of JSON and GIS data
  • Excellent knowledge of Azure data lake storage and Oracle database
  • Experience designing incremental loads, CDC processes, and automated schema evolution
  • Ability to implement robust data quality checks, logging, and monitoring in ETL processes
  • Ability to document ETL workflows, metadata, and technical specifications clearly and consistently
  • Familiarity with DevOps and version control best practices.
  • Experience with CI/CD pipelines
  • Experience working in an Agile and Scrum framework
  • Analysis and problem solving skills
  • Ability to participate in technical meetings and good communication skills
  • Ability to participate in multilingual meetings
  • Ability to work in multi-cultural environment, on multiple large projects; Excellent Team Player
  • Specific expertise (mandatory) at least 5 years of excellent knowledge in Azure Data Lake Storage, Microsoft Fabric OneLake, and Oracle databases
  • at least 5 years of excellent expertise in developing data pipelines from REST APIs and on integration (such as Azure Synapse, PySpark, Microsoft Fabric, Python, SQL, KNIME)
  • at least 5 years of excellent expertise in processing JSON and GIS data
  • Certificates (mandatory) Microsoft Azure Data Engineer Associate
  • Following certifications are a plus: Microsoft Certified: Azure Solutions Architect Expert
  • Microsoft Certified: Azure Developer Associate
  • Microsoft Certified: Azure Database Administrator Associate

Benefits

  • Freelance B2B
  • Professional development opportunities

Job title

Azure Data Engineer

Job type

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job