Azure Data Engineer responsible for designing and automating data platforms within Microsoft Azure ecosystem. Ensuring scalable and reliable data solutions using IaC and CI/CD practices.
Responsibilities
Design & Implement ETL/ELT: Develop, optimize, and maintain scalable data pipelines using Python, SQL, and core Azure data services.
Architect and manage key Azure data components, including Data Lakes, Data Processing, Data Warehousing, and Data Modeling and Quality.
Design, manage, and provision all Azure data resources using Terraform or Azure Resource Manager (ARM) Templates/Bicep.
Build and maintain automated CI/CD pipelines for all code using Azure DevOps or GitHub Actions.
Utilize Docker and manage deployment environments using Azure Kubernetes Service (AKS) or Azure Container Instances (ACI).
Configure monitoring and alerting using Azure Monitor and Log Analytics with implemented network security and access controls (RBAC).
Requirements
Strong hands-on experience designing and deploying end-to-end data solutions specifically within the Azure ecosystem.
High proficiency in Python (including PySpark) and expert knowledge of SQL.
Proven, production-level experience with Terraform (preferred) or ARM/Bicep for automating Azure infrastructure deployment.
Experience setting up CI/CD workflows using Azure DevOps Pipelines or GitHub Actions.
Deep working knowledge of Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Experience with workflow orchestration tools like Azure Data Factory or Apache Airflow.
Mechanical/Reliability Engineer responsible for mechanical installations in Bergen op Zoom. Analyzing maintenance strategies and leading projects to enhance reliability.
Senior DevOps Engineer responsible for cloud infrastructure and deployments. Optimizing AWS services and ensuring system security and reliability for Verizon.
Senior DevOps Engineer responsible for automating infrastructure and building CI/CD pipelines for collaborative robotics company. Collaborating with global engineering teams from the Bangalore office.
Site Reliability Engineer Intern at Tencent working on gaming services and cloud native solutions. Collaborating with global teams to eliminate toil and enhance reliability.
Cloud/DevOps Specialist at N5X managing and optimizing critical cloud infrastructures for Brazilian energy trading. Collaborating with a multidisciplinary team to ensure high availability and performance.
Cloud/Devops Specialist responsible for designing a hybrid architecture combining cloud and on - premises infrastructure for energy trading systems. Collaborating with a multidisciplinary team in a dynamic environment.
Reliability Engineering Specialist utilizing reliability tools and models to improve asset performance at Enbridge. Collaborating across teams to guide investment decisions for safe operations.
DevOps Engineer responsible for structuring and supporting cloud DevOps architecture in Brazil. Working strategically on automation and CI/CD practices with development teams in Pernambuco.
DevSecOps Software Engineer developing secure CI/CD pipelines for Boeing's military software systems. Collaborate with cross - functional teams and implement automation and security best practices.
DevOps Manager responsible for managing a team for multi - cloud solutions supporting the USAF Cloud One project. Focus on scalable cloud - native solutions and CI/CD practices.