Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
About the role
- Senior Data Engineer designing and developing scalable data pipelines using Azure Databricks and BI architectures. Collaborating for healthcare analytics and decision-making in a hybrid workplace.
Responsibilities
- Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
- Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
- Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
- Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
- Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
- Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights
Requirements
- 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
- 3+ years of hands-on experience with **Azure Databricks**
- Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
- Proficiency in **Python** and expert-level skills in **SQL**
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
- Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
- Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
- Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.