Data Engineer creating and operating data pipelines in SQL Server or Azure Databricks environments. Supporting business needs and enhancing data quality for healthcare outcomes with a focus on automation.
Responsibilities
The Data Engineer creates, operates, and extends data pipelines and/or orchestration solutions built in SQL Server or Azure Databricks environments.
This role develops solutions to support the business and operational needs of internal and external partners, commonly applying SQL and ETL tools to optimize outcomes.
Design and Develop Data Pipelines: Creates and maintains robust data pipelines using Databricks, Spark, SQL, or SSIS.
ETL/ELT Processes: Develops and manages efficient ETL/ELT processes for data extraction, transformation, and loading.
Data Integration: Integrates data from various sources, ensuring data quality and consistency.
Query Writing and Optimization: Writes, optimizes, and maintains complex SQL queries to enhance performance.
Collaborate with Stakeholders: Works closely with analysts and stakeholders to understand data requirements and deliver solutions.
Performance Tuning: Optimizes data pipelines, SQL queries, and Delta Tables to ensure high performance and scalability.
Data Quality Assurance: Ensures the accuracy and reliability of data through rigorous testing and validation.
Documentation: Maintains comprehensive documentation of data pipelines, processes, and query optimizations.
Continuous Improvement: Identifies and implements opportunities for process improvements and automation.
Requirements
Bachelor’s degree in computer science, Mathematics, Statistics, or a related field.
Minimum 4 years of experience in data engineering, including:
Advanced SQL
Azure Data Factory or other ETL tools
Python or other programming languages
Azure Databricks or Spark
Azure DevOps or other CI/CD tools
Strong analytical and problem-solving skills.
Excellent communication and interpersonal skills.
Ability to work independently and as part of a team.
Strong attention to detail and ability to maintain data accuracy and integrity.
Preferred Qualifications:
Experience in healthcare, particularly specialty pharmacy.
Familiarity with healthcare data standards such as HIPAA and HITECH.
Proficiency working with Azure Log Analytics.
Knowledge of dimensional data modeling.
Data Warehousing Experience
Benefits
Hybrid, remote and flexible on-site work schedules are available, based on the position.
PANTHERx Rare Pharmacy also affords an excellent benefit package, including but not limited to medical, dental, vision, health savings and flexible spending accounts, 401K with employer matching, employer-paid life insurance and short/long term disability coverage, and an Employee Assistance Program!
Generous paid time off is also available to all full-time employees, as well as limited paid time off for part-time employees.
Journeyman Data Architect supporting Leidos' enterprise data and analytics program for the Department of War. Collaborating on solutions for data architecture, cloud environments, and governance.
Senior Software Engineer developing backend services and data infrastructure for integrated products at Booz Allen. Collaborating with a small elite team to deliver reliable and scalable services.
AWS Streaming Data Engineer developing software and systems in a fast, agile environment. Utilizing experience with real - time data ingestion and processing systems across distributed environments.
Mid - level Data Engineer ensuring efficient data transformation and integration for data annotation projects. Collaborating with teams to optimize data quality and performance in pipeline operations.
Cloud Data Platform Administrator supporting deployment and operations of modern Enterprise Data Platform. Focus on AWS infrastructure, CI/CD integration, and secure cloud operations.
Data Engineer developing and maintaining data architecture for Business Intelligence platform. Collaborating with data analysts to build interactive dashboards and real - time insights.
Principal Data Architect at nbn defining and evolving enterprise data models for the digital future of Australia. Providing leadership in data governance and advanced analytics practices.
Data Engineering Advisor creating data systems and pipelines for data management solutions. Collaborating with stakeholders and using analytics to solve business problems in the financial sector.
Senior Finance Data Architect responsible for shaping finance data strategy at Standard Life. Leading enterprise - level data architecture for regulatory reporting and strategic insights.