Hybrid Data Engineer, Databricks

Posted 4 hours ago

Apply now

About the role

  • Databricks Data Engineer developing scalable data pipelines within the insurance domain. Building ETL workflows on Azure and Databricks for analytics and business decision-making.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Azure technologies
  • Build and optimise PySpark and SQL-based data processing workflows
  • Work closely with data analysts, reporting teams, and business stakeholders
  • Develop and maintain data models aligned to insurance data structures
  • Implement robust data validation and quality frameworks
  • Monitor and troubleshoot data pipelines and batch jobs
  • Identify and resolve performance bottlenecks
  • Ensure data governance, regulatory compliance, and auditability
  • Participate in Agile delivery processes

Requirements

  • 7–12 years of experience in Data Engineering
  • Strong hands-on experience in Databricks and cloud-based data platforms
  • Proven experience working within the insurance industry
  • Strong understanding of insurance data domains
  • Proficiency in PySpark, Python, and SQL
  • Extensive experience building ETL/ELT pipelines and scalable data architectures
  • Hands-on experience with Azure cloud technologies
  • Experience working with Delta Lake architecture and modern data warehousing patterns
  • Familiarity with Agile methodologies

Benefits

  • A competitive salary with a generous bonus
  • Private healthcare
  • Critical illness life assurance at 4 x your annual salary
  • Income protection insurance
  • A rewarding pension
  • Cash back cards for discounts and promotions
  • Cycle Scheme for savings on bikes and cycling accessories
  • Professional and personal development opportunities
  • Support for various learning initiatives
  • Employee Stock Purchase Plan (ESPP)
  • Flexible hybrid working model

Job title

Data Engineer, Databricks

Job type

Experience level

SeniorLead

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job