Hybrid Principal Data Engineer

at Moneyhub

• Job title: Principal Data Engineer
• Job type: Full Time
• Experience level: Lead
• Salary: Not specified
• Degree requirement: No Education Requirement
• Tech skills: Apache, AWS, Azure, BigQuery, Cloud, Distributed Systems, Google Cloud Platform, JavaScript, Kafka, Node.js, Spark
• Location requirements: Hybrid, United Kingdom

About the role

• Principal Data Engineer leading the design and development at Moneyhub. Overseeing large-scale data systems and problems for financial services with a hands-on approach.

Responsibilities

• Evolve a Mission-Critical System: Take technical ownership of our Kafka-based Data Enrichment Engine, a platform that runs multiple analytical models at 20,000+ transactions per second.
• Architect for Scale: Design and implement architectural improvements to enhance the platform's performance, reliability, and scalability across both our SaaS and client-deployed environments.
• Solve Complex Engineering Challenges: Tackle deep technical problems related to high-throughput data ingestion, distributed systems, data consistency, and operational efficiency in a live production environment.
• Act as the Subject Matter Expert (SME): As the go-to expert for the toughest data infrastructure challenges, you'll partner closely with our DevSecOps team to ensure production excellence. You will guide and mentor other engineers, establishing best practices for building and operating large-scale data systems.

Requirements

• Leader of the design and development of large-scale data systems from scratch, making key design decisions and providing technical oversight of projects.
• Expert-level, hands-on experience with Apache Kafka, including designing, deploying, and operating it in a high-throughput production environment.
• Experience designing, managing, and running relational databases at a terabyte scale.
• Deep knowledge of how technologies such as Apache Spark, BigQuery or AWS Athena work including principles such as map/reduce and schema-on-read.
• Strong software engineering fundamentals with proficiency in a backend language, preferably JavaScript/Node.js.
• Demonstrable experience building solutions on a major public cloud platform (GCP, AWS, or Azure) with an ability to price expected running costs of solutions
• A pragmatic and autonomous problem-solver who takes end-to-end ownership, can unblock themselves by digging into documentation, and knows when to create a simple solution vs. an architecturally complex one.

Benefits

• 5% company contribution towards your Pension from your very first day with us. 3% contribution from yourself.
• 25 days of holiday (plus bank hols), rising to 30 days after two years;
• Choose to take your entitlement to UK bank holidays at other times based on your own days of significance;
• Private medical insurance, including cover for pre-existing conditions, plus dental and optical benefit;
• 3 Months Moneyhubber Family Pay when you become a new parent;
• Permanent health insurance and life cover - much greater than the industry standard (death in service);
• Employee assistance programme;
• Professional development support, with dedicated allowance of time and money; Life event leave;
• Cycle to work scheme;
• EV Car Scheme
• £750 towards professional memberships
• Remote working benefits, including work from almost anywhere, access to co-working spaces and support for your home office set-up
• High spec laptop