Senior Data Engineer leading tailored data-driven solutions delivery for public sector clients. Involves data transformation projects and building AI-powered tools for decision making.
Responsibilities
Influencing major digital and data transformation projects across the UK public sector
Building and utilising smart, AI-powered tools that support real decision making
Using tech to make a genuine difference in society
Lead the delivery of tailored solutions to clients
Responsible for the design, delivery, and implementation of solutions spanning end-user interfaces and innovative user experience to data-driven solutions
Lead the end-to-end delivery of data and digital solutions of varying scale and complexity across multiple technical domains
Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments
Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements
Analyse and consolidate business requirements and use cases to meet technical and non-technical debt
Make key decisions on build vs buy for data and digital engineering solutions and platforms
Requirements
Data Engineering Expertise
Proficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch
Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open-source frameworks including Spark, Beam, and Airflow
Hands-on experience with real-time data streaming technologies (e.g., Kafka, Pub/Sub)
Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls
Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads
Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions)
Experience working within Data Lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage
Practical understanding of at least one major cloud provider (AWS or Azure)
Strong analytical and problem-solving skills
Excellent communication skills
Demonstrated ability to collaborate effectively within distributed or remote teams
A willingness to mentor and support colleagues in their professional development.
The successful candidate must hold or be required to go through an SC security clearance.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.