Senior Data Engineer leading tailored data-driven solutions delivery for public sector clients. Involves data transformation projects and building AI-powered tools for decision making.
Responsibilities
Influencing major digital and data transformation projects across the UK public sector
Building and utilising smart, AI-powered tools that support real decision making
Using tech to make a genuine difference in society
Lead the delivery of tailored solutions to clients
Responsible for the design, delivery, and implementation of solutions spanning end-user interfaces and innovative user experience to data-driven solutions
Lead the end-to-end delivery of data and digital solutions of varying scale and complexity across multiple technical domains
Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments
Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements
Analyse and consolidate business requirements and use cases to meet technical and non-technical debt
Make key decisions on build vs buy for data and digital engineering solutions and platforms
Requirements
Data Engineering Expertise
Proficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch
Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open-source frameworks including Spark, Beam, and Airflow
Hands-on experience with real-time data streaming technologies (e.g., Kafka, Pub/Sub)
Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls
Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads
Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions)
Experience working within Data Lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage
Practical understanding of at least one major cloud provider (AWS or Azure)
Strong analytical and problem-solving skills
Excellent communication skills
Demonstrated ability to collaborate effectively within distributed or remote teams
A willingness to mentor and support colleagues in their professional development.
The successful candidate must hold or be required to go through an SC security clearance.
Program Manager leading enterprise - wide data migration efforts for Boeing's transition to modern data platforms. Overseeing complex processes to ensure secure and effective migrations across multiple systems.
Senior Data Engineer responsible for developing data products for Disney's immersive digital experiences. Collaborating with teams to ensure data quality and operational efficiency in a fast - paced environment.
Senior Data Engineer crafting and developing data products for analytical insights at Zendesk. Collaborating in an Agile environment with a focus on data warehousing and process optimization.
Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross - functional teams to facilitate data insights and analytics.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.