About the role

  • Data Engineer at Barnet Council developing Microsoft Azure data platforms and robust data pipelines for analytics. Collaborating on data solutions and improving data quality across organization.

Responsibilities

  • Develop and maintain the council’s Microsoft Azure Data Platform, supporting cloudready, scalable analytics.
  • Build and optimise data pipelines, APIs and integrations across onpremise, cloud and supplierhosted systems.
  • Extract, clean, transform and combine data from a wide range of operational systems to create highquality datasets for insight and machine learning.
  • Work with data scientists to design and maintain pipelines for AI/ML models, including supporting feature engineering, labelling and largescale data flows.
  • Automate manual data processes to improve speed, reliability and accessibility of insight.
  • Lead data engineering projects, including working with external suppliers and supporting more junior colleagues.
  • Implement and maintain data lakehouse architectures, master data management and metadata repositories.
  • Ensure that data workflows comply with security, privacy and governance standards, including anonymisation where required.
  • Optimise the performance of code, pipelines and data systems, resolving issues, bugs and outages.
  • Contribute to the development of data strategy, standards and reusable engineering frameworks across the Hub.
  • Work with colleagues across ICT, Connected Places and service teams to join up data and support emerging technologies (e.g., IoT, geospatial, AI).
  • Support the creation of visualisations and reusable analytical products that enhance decisionmaking.

Requirements

  • Strong handson experience with modern data engineering tools and practices, including ETL/ELT, data warehousing and data modelling.
  • Expertise in cloud data platforms, ideally Azure services such as Data Factory, Synapse, Databricks, Spark or Snowflake.
  • Proficiency in Python, SQL and other relevant languages for building pipelines and enabling automation.
  • Experience building and managing production data services, integrating data from multiple systems, and improving data quality.
  • Understanding of data governance, security, information management and UK GDPR.
  • The ability to communicate complex technical concepts clearly for nonspecialist audiences.
  • A collaborative and proactive approach, with confidence leading projects, supporting partners and driving continuous improvement.

Benefits

  • 31 days annual leave, plus public and bank holidays
  • Access to the Local Government Pension Scheme, which provides a valuable guaranteed income in your retirement together with security for your dependents
  • Work-life balance options may include hybrid working, flexitime, job share, home working, part-time
  • A vast range of lifestyle discounts from major retailers, supermarkets, energy suppliers and more
  • Broad range of payroll benefits including cycle to work, eye care vouchers, travel and gym membership
  • Excellent training and development opportunities
  • Employee well-being training programs including confidential employee assistance

Job title

Data Engineer

Job type

Experience level

Mid levelSenior

Salary

£48,003 - £53,172 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job