Data Engineer creating and operating data pipelines in SQL Server or Azure Databricks environments. Supporting business needs and enhancing data quality for healthcare outcomes with a focus on automation.
Responsibilities
The Data Engineer creates, operates, and extends data pipelines and/or orchestration solutions built in SQL Server or Azure Databricks environments.
This role develops solutions to support the business and operational needs of internal and external partners, commonly applying SQL and ETL tools to optimize outcomes.
Design and Develop Data Pipelines: Creates and maintains robust data pipelines using Databricks, Spark, SQL, or SSIS.
ETL/ELT Processes: Develops and manages efficient ETL/ELT processes for data extraction, transformation, and loading.
Data Integration: Integrates data from various sources, ensuring data quality and consistency.
Query Writing and Optimization: Writes, optimizes, and maintains complex SQL queries to enhance performance.
Collaborate with Stakeholders: Works closely with analysts and stakeholders to understand data requirements and deliver solutions.
Performance Tuning: Optimizes data pipelines, SQL queries, and Delta Tables to ensure high performance and scalability.
Data Quality Assurance: Ensures the accuracy and reliability of data through rigorous testing and validation.
Documentation: Maintains comprehensive documentation of data pipelines, processes, and query optimizations.
Continuous Improvement: Identifies and implements opportunities for process improvements and automation.
Requirements
Bachelor’s degree in computer science, Mathematics, Statistics, or a related field.
Minimum 4 years of experience in data engineering, including:
Advanced SQL
Azure Data Factory or other ETL tools
Python or other programming languages
Azure Databricks or Spark
Azure DevOps or other CI/CD tools
Strong analytical and problem-solving skills.
Excellent communication and interpersonal skills.
Ability to work independently and as part of a team.
Strong attention to detail and ability to maintain data accuracy and integrity.
Preferred Qualifications:
Experience in healthcare, particularly specialty pharmacy.
Familiarity with healthcare data standards such as HIPAA and HITECH.
Proficiency working with Azure Log Analytics.
Knowledge of dimensional data modeling.
Data Warehousing Experience
Benefits
Hybrid, remote and flexible on-site work schedules are available, based on the position.
PANTHERx Rare Pharmacy also affords an excellent benefit package, including but not limited to medical, dental, vision, health savings and flexible spending accounts, 401K with employer matching, employer-paid life insurance and short/long term disability coverage, and an Employee Assistance Program!
Generous paid time off is also available to all full-time employees, as well as limited paid time off for part-time employees.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.
Data Engineer developing and maintaining ETL processes with Informatica IDMC for BMW TechWorks Romania. Collaborating with teams to implement cloud - based data architecture solutions.
Microsoft Data Architect designing and building business intelligence solutions on Azure. Collaborating with teams and engaging clients for strategic data solutions.
Senior Data Engineer developing data - pipelines and deploying AI tools for Mariner's ecosystem. Collaborating with cross - departmental teams to enhance enterprise data products and systems integrations.
Data Architect for Amazon leading data strategy and advanced analytics solutions. Collaborating with cross - functional teams to drive measurable value and enhance data literacy across the organization.
Data Platform Engineer at Taxfix managing data infrastructures and pipelines to support analytics and AI - driven product features. Collaborating with cross - functional teams to ensure data reliability.
Mid - level Data Engineer building secure, scalable data infrastructure on AWS for fintech startup TrueLayer. Collaborating with DevOps and Analytics teams to enhance data operations.
Data Architect responsible for enterprise data architecture and solutions at NMC. Collaborating with various teams while evolving Microsoft D365 data architecture.
Senior Data Engineer developing robust data pipelines and optimizing databases for Atecna clients. Contributing to the growth of Atecna’s Data community with expertise.