Principal Data Engineer leading the design and development at Moneyhub. Overseeing large-scale data systems and problems for financial services with a hands-on approach.
Responsibilities
Evolve a Mission-Critical System: Take technical ownership of our Kafka-based Data Enrichment Engine, a platform that runs multiple analytical models at 20,000+ transactions per second.
Architect for Scale: Design and implement architectural improvements to enhance the platform's performance, reliability, and scalability across both our SaaS and client-deployed environments.
Solve Complex Engineering Challenges: Tackle deep technical problems related to high-throughput data ingestion, distributed systems, data consistency, and operational efficiency in a live production environment.
Act as the Subject Matter Expert (SME): As the go-to expert for the toughest data infrastructure challenges, you'll partner closely with our DevSecOps team to ensure production excellence. You will guide and mentor other engineers, establishing best practices for building and operating large-scale data systems.
Requirements
Leader of the design and development of large-scale data systems from scratch, making key design decisions and providing technical oversight of projects.
Expert-level, hands-on experience with Apache Kafka, including designing, deploying, and operating it in a high-throughput production environment.
Experience designing, managing, and running relational databases at a terabyte scale.
Deep knowledge of how technologies such as Apache Spark, BigQuery or AWS Athena work including principles such as map/reduce and schema-on-read.
Strong software engineering fundamentals with proficiency in a backend language, preferably JavaScript/Node.js.
Demonstrable experience building solutions on a major public cloud platform (GCP, AWS, or Azure) with an ability to price expected running costs of solutions
A pragmatic and autonomous problem-solver who takes end-to-end ownership, can unblock themselves by digging into documentation, and knows when to create a simple solution vs. an architecturally complex one.
Benefits
5% company contribution towards your Pension from your very first day with us. 3% contribution from yourself.
25 days of holiday (plus bank hols), rising to 30 days after two years;
Choose to take your entitlement to UK bank holidays at other times based on your own days of significance;
Private medical insurance, including cover for pre-existing conditions, plus dental and optical benefit;
3 Months Moneyhubber Family Pay when you become a new parent;
Permanent health insurance and life cover - much greater than the industry standard (death in service);
Employee assistance programme;
Professional development support, with dedicated allowance of time and money; Life event leave;
Cycle to work scheme;
EV Car Scheme
£750 towards professional memberships
Remote working benefits, including work from almost anywhere, access to co-working spaces and support for your home office set-up
Program Manager leading enterprise - wide data migration efforts for Boeing's transition to modern data platforms. Overseeing complex processes to ensure secure and effective migrations across multiple systems.
Senior Data Engineer responsible for developing data products for Disney's immersive digital experiences. Collaborating with teams to ensure data quality and operational efficiency in a fast - paced environment.
Senior Data Engineer crafting and developing data products for analytical insights at Zendesk. Collaborating in an Agile environment with a focus on data warehousing and process optimization.
Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross - functional teams to facilitate data insights and analytics.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.