Data Engineer supporting data pipelines for business insights and GenAI applications at Assurity Trusted Solutions. Collaborating with teams on data workflows in a hybrid environment.
About the role
- Senior Data Engineer designing and developing scalable data pipelines using Azure Databricks and BI architectures. Collaborating for healthcare analytics and decision-making in a hybrid workplace.
Responsibilities
- Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
- Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
- Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
- Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
- Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
- Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights
Requirements
- 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
- 3+ years of hands-on experience with **Azure Databricks**
- Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
- Proficiency in **Python** and expert-level skills in **SQL**
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
- Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
- Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
- Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer leveraging big data and cloud expertise to build data pipelines at Alight. Ensuring reliability, governance, and operational excellence across data platforms.
Data & AI Engineer at Decathlon Colombia designing and optimizing data ecosystems. Involves building data pipelines and deploying machine learning models.
Senior hands - on engineering lead at Electric Mind focusing on data platforms, AI, and analytics. Collaborating with teams on complex, mission - critical transformations in technology solutions.
AI Data Engineer (Azure + Copilot Studio) developing data pipelines and AI agent solutions. Involves working with Azure Data Factory, Copilot Studio, and data integration in a hybrid role.
Data Engineer developing scalable data architectures supporting analytics and ML at Porto Bank. Ensuring quality and efficient data integration while managing risks and standards.
Senior Data Engineer in Porto Bank developing and managing scalable data architectures and systems. Focused on integrating diverse data solutions while identifying and managing risks.
Engineer of Data designing and architecting data for educational intelligence. Collaborating on data analytics and visualization in business decision - making processes.
Senior Data Engineer building data pipelines and analytics solutions in a healthcare - focused R&D environment. Collaborating with cross - functional teams to support AI and scientific advancement.
Lead Data Engineer building reliable data infrastructure at Eve, a legal technology company. Architecting data systems to enable data - driven decision making for law firms.