Senior Data Architect responsible for building data infrastructure at Trexquant, integrating diverse datasets for research and simulation applications. Collaborating with teams to enhance data accessibility and quality.
About the role
- Senior Data Engineer leading tailored data-driven solutions delivery for public sector clients. Involves data transformation projects and building AI-powered tools for decision making.
Responsibilities
- Influencing major digital and data transformation projects across the UK public sector
- Building and utilising smart, AI-powered tools that support real decision making
- Using tech to make a genuine difference in society
- Lead the delivery of tailored solutions to clients
- Responsible for the design, delivery, and implementation of solutions spanning end-user interfaces and innovative user experience to data-driven solutions
- Lead the end-to-end delivery of data and digital solutions of varying scale and complexity across multiple technical domains
- Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments
- Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements
- Analyse and consolidate business requirements and use cases to meet technical and non-technical debt
- Make key decisions on build vs buy for data and digital engineering solutions and platforms
Requirements
- Data Engineering Expertise
- Proficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch
- Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open-source frameworks including Spark, Beam, and Airflow
- Hands-on experience with real-time data streaming technologies (e.g., Kafka, Pub/Sub)
- Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls
- Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads
- Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions)
- Experience working within Data Lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage
- Practical understanding of at least one major cloud provider (AWS or Azure)
- Strong analytical and problem-solving skills
- Excellent communication skills
- Demonstrated ability to collaborate effectively within distributed or remote teams
- A willingness to mentor and support colleagues in their professional development.
- The successful candidate must hold or be required to go through an SC security clearance.
Benefits
- 25 days annual leave plus birthday off
- Ability to buy and sell 5 days holiday
- Private Healthcare Coverage
- Training & Skills Development
- Fitness Reimbursement
- Life Assurance
- Pension Contribution
- Perkbox Subscription
- Flexible Work Arrangements
- Internal Reward Schemes
- Community Engagement & Volunteer Opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for developing data solutions and integrating systems for advanced analytics at Lilly. Focusing on data pipelines and solutions ensuring data quality and compliance.
Junior Data Engineer assisting with data - driven use - cases in the payment sector. Contributing to the establishment of a central data platform at S - Payment.
Technical Lead in Data Engineering at Intentsify, building scalable applications for B2B marketing solutions. Leading a small team and making key technological decisions.
Data Engineer developing scalable data pipelines for RunBuggy's automotive logistics platform. Collaborate with cross - functional teams to unlock powerful insights and optimize data infrastructure.
Working Student in Data Engineering supporting the development of an energy management app's data backbone across Europe. Collaborate with diverse teams to ensure data quality and optimization.
Senior Data Engineer at Minsait responsible for designing and maintaining data infrastructure. Ensuring efficient and secure data collection, storage, and processing across various sectors.
Senior Data Engineer developing and maintaining scalable data pipelines at Quality Digital. Ensuring data quality, security, and compliance with best practices while collaborating with data teams.
AI Data Engineer at Convatec designing and deploying data and AI workflows. Collaborating with AI Engineers and Data Scientists to maintain data pipelines and support analytics.
Data Engineer designing and developing data pipelines and infrastructure for processing and analyzing large data volumes at CIAL. Collaborating with data scientists to meet data requirements.