Senior Associate in Azure Data Engineering at PwC designing and maintaining enterprise data platforms on Azure. Collaborating with teams to deliver high-quality data solutions.
Responsibilities
Architect, design, and own development of robust end-to-end data pipelines utilizing Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
Lead design and implementation of advanced data models within Azure Data Lake
Champion Medallion Architecture and build complex business logic using PySpark and Delta Lake
Develop ETL/ELT processes to ingest data from various sources
Automate data workflows and implement CI/CD practices using Azure DevOps or GitHub Actions
Monitor, troubleshoot, and optimize data solutions
Mentor junior data engineers and establish coding standards and best practices
Requirements
Microsoft Azure Data Engineer Associate (DP-203) certification required, or ability to obtain within first 2 months
5-7 years of hands-on experience in data engineering role
Deep expertise with core Azure data services: Azure Data Factory, Azure Databricks, Azure Data Lake Storage
Expert-level proficiency in SQL and Python
Extensive experience with PySpark for large-scale data processing
Strong understanding of ELT patterns, data warehousing, data lake architectures
Bachelor's degree in computer science, Engineering, Information Technology, or related field
Significant experience with Azure Synapse Analytics
Experience building and managing CI/CD pipelines using Azure DevOps
Proficiency with Infrastructure as Code (Bicep preferred, Terraform is a plus)
Strong understanding of Azure security best practices
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.