Databricks Data Engineer developing scalable data pipelines within the insurance domain. Building ETL workflows on Azure and Databricks for analytics and business decision-making.
Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Azure technologies
Build and optimise PySpark and SQL-based data processing workflows
Work closely with data analysts, reporting teams, and business stakeholders
Develop and maintain data models aligned to insurance data structures
Implement robust data validation and quality frameworks
Monitor and troubleshoot data pipelines and batch jobs
Identify and resolve performance bottlenecks
Ensure data governance, regulatory compliance, and auditability
Participate in Agile delivery processes
Requirements
7–12 years of experience in Data Engineering
Strong hands-on experience in Databricks and cloud-based data platforms
Proven experience working within the insurance industry
Strong understanding of insurance data domains
Proficiency in PySpark, Python, and SQL
Extensive experience building ETL/ELT pipelines and scalable data architectures
Hands-on experience with Azure cloud technologies
Experience working with Delta Lake architecture and modern data warehousing patterns
Familiarity with Agile methodologies
Benefits
A competitive salary with a generous bonus
Private healthcare
Critical illness life assurance at 4 x your annual salary
Income protection insurance
A rewarding pension
Cash back cards for discounts and promotions
Cycle Scheme for savings on bikes and cycling accessories
Professional and personal development opportunities
Data Scientist developing customer - focused data products to improve customer journey at Noibu. Collaborating with teams to analyze feedback data and shape analytics strategies.
Data Engineer at fundcraft ensuring seamless data movement and storage. Focus on data migrations, ETL maintenance, and collaboration with the Product team for insights.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Leading development of scalable cloud and data governance solutions while mentoring engineering teams.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Driving architecture, development, and implementation of scalable cloud and data governance solutions.
Azure Data Engineer responsible for designing ETL pipelines with Azure Data Factory and Snowflake. Collaborating with teams to ensure data integration and quality.
Data Engineer Intern building and maintaining data pipelines for AI - driven financial insights. Opportunity to work at forefront of technology in a collaborative start - up environment.
Data Architect responsible for designing and maintaining data architecture at Uriage & Apivita. Leading data management efforts to support analytics and ensure high - quality data flows across systems.
Data Engineer at Flip building and maintaining scalable data pipelines for ingestion into BigQuery and collaborating with data analysts to enable insights.
Senior Data Engineer building scalable data pipelines and supporting analytics for insurTech platform. Collaborating with cross - functional teams to drive data - driven decisions and improve services.