Data Engineer at Barnet Council developing Microsoft Azure data platforms and robust data pipelines for analytics. Collaborating on data solutions and improving data quality across organization.
Responsibilities
Develop and maintain the council’s Microsoft Azure Data Platform, supporting cloudready, scalable analytics.
Build and optimise data pipelines, APIs and integrations across onpremise, cloud and supplierhosted systems.
Extract, clean, transform and combine data from a wide range of operational systems to create highquality datasets for insight and machine learning.
Work with data scientists to design and maintain pipelines for AI/ML models, including supporting feature engineering, labelling and largescale data flows.
Automate manual data processes to improve speed, reliability and accessibility of insight.
Lead data engineering projects, including working with external suppliers and supporting more junior colleagues.
Implement and maintain data lakehouse architectures, master data management and metadata repositories.
Ensure that data workflows comply with security, privacy and governance standards, including anonymisation where required.
Optimise the performance of code, pipelines and data systems, resolving issues, bugs and outages.
Contribute to the development of data strategy, standards and reusable engineering frameworks across the Hub.
Work with colleagues across ICT, Connected Places and service teams to join up data and support emerging technologies (e.g., IoT, geospatial, AI).
Support the creation of visualisations and reusable analytical products that enhance decisionmaking.
Requirements
Strong handson experience with modern data engineering tools and practices, including ETL/ELT, data warehousing and data modelling.
Expertise in cloud data platforms, ideally Azure services such as Data Factory, Synapse, Databricks, Spark or Snowflake.
Proficiency in Python, SQL and other relevant languages for building pipelines and enabling automation.
Experience building and managing production data services, integrating data from multiple systems, and improving data quality.
Understanding of data governance, security, information management and UK GDPR.
The ability to communicate complex technical concepts clearly for nonspecialist audiences.
A collaborative and proactive approach, with confidence leading projects, supporting partners and driving continuous improvement.
Benefits
31 days annual leave, plus public and bank holidays
Access to the Local Government Pension Scheme, which provides a valuable guaranteed income in your retirement together with security for your dependents
Work-life balance options may include hybrid working, flexitime, job share, home working, part-time
A vast range of lifestyle discounts from major retailers, supermarkets, energy suppliers and more
Broad range of payroll benefits including cycle to work, eye care vouchers, travel and gym membership
Excellent training and development opportunities
Employee well-being training programs including confidential employee assistance
Data Migration Specialist managing ongoing Salesforce data quality initiatives for Abby Care. Executing and validating data migrations while ensuring data accuracy.
Lead Data Engineer overseeing and managing the Data Engineering team. Developing ETL pipelines and ensuring data integrity within Cloud (Azure) infrastructure.
Data Engineer designing and optimizing data solutions for Qualco Intelligent Finance. Focus on data integrity, consistency, and reusability in analytics deliverables within a hybrid environment.
Data Architect leading data architecture and design for LifeByte's technology ecosystem. Collaborating with multiple teams to ensure robust data governance, compliance, and innovative strategies.
Data Engineer developing data solutions for major UK consumer brands. Collaborating with the Product & Technology team to meet diverse data requirements.
Senior Data Engineer building and managing data pipelines at Immediate Media. Collaborating with cross - functional teams to deliver robust data solutions and ensure data quality.
Data Engineer Team Lead at iKnowHow S.A leading Data Engineering team for outsourced projects. Driving scalable data solutions and fostering team collaboration with technical expertise.
Associate Data Engineer undergoing training in data engineering tools and collaborating with senior engineers on projects. Hands - on experience with real - world datasets and cloud - based platforms.
Data Engineer developing data infrastructures and pipelines for Motive's Enterprise clients. Collaborating across teams to enhance data processing with modern tools and frameworks.