Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
About the role
- Principal Data Engineer leading the design and development at Moneyhub. Overseeing large-scale data systems and problems for financial services with a hands-on approach.
Responsibilities
- Evolve a Mission-Critical System: Take technical ownership of our Kafka-based Data Enrichment Engine, a platform that runs multiple analytical models at 20,000+ transactions per second.
- Architect for Scale: Design and implement architectural improvements to enhance the platform's performance, reliability, and scalability across both our SaaS and client-deployed environments.
- Solve Complex Engineering Challenges: Tackle deep technical problems related to high-throughput data ingestion, distributed systems, data consistency, and operational efficiency in a live production environment.
- Act as the Subject Matter Expert (SME): As the go-to expert for the toughest data infrastructure challenges, you'll partner closely with our DevSecOps team to ensure production excellence. You will guide and mentor other engineers, establishing best practices for building and operating large-scale data systems.
Requirements
- Leader of the design and development of large-scale data systems from scratch, making key design decisions and providing technical oversight of projects.
- Expert-level, hands-on experience with Apache Kafka, including designing, deploying, and operating it in a high-throughput production environment.
- Experience designing, managing, and running relational databases at a terabyte scale.
- Deep knowledge of how technologies such as Apache Spark, BigQuery or AWS Athena work including principles such as map/reduce and schema-on-read.
- Strong software engineering fundamentals with proficiency in a backend language, preferably JavaScript/Node.js.
- Demonstrable experience building solutions on a major public cloud platform (GCP, AWS, or Azure) with an ability to price expected running costs of solutions
- A pragmatic and autonomous problem-solver who takes end-to-end ownership, can unblock themselves by digging into documentation, and knows when to create a simple solution vs. an architecturally complex one.
Benefits
- 5% company contribution towards your Pension from your very first day with us. 3% contribution from yourself.
- 25 days of holiday (plus bank hols), rising to 30 days after two years;
- Choose to take your entitlement to UK bank holidays at other times based on your own days of significance;
- Private medical insurance, including cover for pre-existing conditions, plus dental and optical benefit;
- 3 Months Moneyhubber Family Pay when you become a new parent;
- Permanent health insurance and life cover - much greater than the industry standard (death in service);
- Employee assistance programme;
- Professional development support, with dedicated allowance of time and money; Life event leave;
- Cycle to work scheme;
- EV Car Scheme
- £750 towards professional memberships
- Remote working benefits, including work from almost anywhere, access to co-working spaces and support for your home office set-up
- High spec laptop
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Data Engineer focusing on secure ETL/ELT data pipelines and compliance in healthcare. Designing scalable ingestion frameworks and ensuring alignment with federal standards.