Azure Data Engineer responsible for designing and automating data platforms within Microsoft Azure ecosystem. Ensuring scalable and reliable data solutions using IaC and CI/CD practices.
Responsibilities
Design & Implement ETL/ELT: Develop, optimize, and maintain scalable data pipelines using Python, SQL, and core Azure data services.
Architect and manage key Azure data components, including Data Lakes, Data Processing, Data Warehousing, and Data Modeling and Quality.
Design, manage, and provision all Azure data resources using Terraform or Azure Resource Manager (ARM) Templates/Bicep.
Build and maintain automated CI/CD pipelines for all code using Azure DevOps or GitHub Actions.
Utilize Docker and manage deployment environments using Azure Kubernetes Service (AKS) or Azure Container Instances (ACI).
Configure monitoring and alerting using Azure Monitor and Log Analytics with implemented network security and access controls (RBAC).
Requirements
Strong hands-on experience designing and deploying end-to-end data solutions specifically within the Azure ecosystem.
High proficiency in Python (including PySpark) and expert knowledge of SQL.
Proven, production-level experience with Terraform (preferred) or ARM/Bicep for automating Azure infrastructure deployment.
Experience setting up CI/CD workflows using Azure DevOps Pipelines or GitHub Actions.
Deep working knowledge of Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Experience with workflow orchestration tools like Azure Data Factory or Apache Airflow.
Sr. Site Reliability Engineer designing and automating robust technical infrastructure at Broadridge. Collaborating across teams for successful deployment and operational support of services.
Senior Fleet Reliability Engineer maintaining high fleet uptime for autonomous vehicle technology. Collaborating with technical teams to ensure peak operational performance in data collection efforts.
DevOps Lead at Leidos managing platform engineering, SRE, and application security functions. Driving operational excellence and ensuring scalability for federal government applications.
SRE Lead developing scalable cloud - native solutions for mission - critical systems supporting USAF. Managing teams, collaborating with cross - functional units, and ensuring high service reliability standards.
Junior DevOps / Platform Engineer at DieEnergiekoppler GmbH managing AWS/EKS platform operations. Collaborating with team members to improve platform functionalities and security compliance.
DevOps Engineer responsible for AWS infrastructures and backend development at Allguth GmbH. Engaging in greenfield projects with modern solutions in a collaborative team.
Cloud DevOps Specialist responsible for building scalable infrastructure solutions in AWS at SONDA. Focusing on automation, containerization, and data management in a collaborative environment.
DevOps Engineer maintaining and evolving deployment pipelines for Docebo’s AI - powered learning platform. Collaborating with cross - functional teams to ensure efficient software releases and infrastructure management.
DevOps Engineer optimizing CI/CD pipelines for Docebo, an AI - powered learning platform. Involves managing multi - tenant infrastructure using AWS, Docker, and Kubernetes.
DevOps Engineer maintaining and automating infrastructure and CI/CD processes for cybersecurity solutions by NordLayer. Collaborating with teams to ensure performance and scalability of cloud services.