Hybrid Senior ML Infrastructure Engineer

at Ellison Institute of Technology Oxford

• Job title: Senior ML Infrastructure Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: Not specified
• Degree requirement: No Education Requirement
• Tech skills: Terraform
• Location requirements: Hybrid, Oxford, United Kingdom

About the role

• Join Ellison Institute of Technology as a Senior ML Infrastructure Engineer. Build and operate high-performance ML infrastructure to enable scientific breakthroughs in Oxford.

Responsibilities

• **Day-to-day, you might:**
• Build, operate, and continuously optimise our high-performance GPU training and inference clusters, focusing on robust, high-availability scheduling, isolation, and automated lifecycle management.
• Drive systems design and implementation for high-throughput data paths, optimising I/O, caching, and data locality across compute and storage (including our current Lustre implementation).
• Proactively benchmark, profile, and resolve performance bottlenecks across the compute, network, and orchestration layers to maximise efficiency for distributed training and inference.
• Establish comprehensive observability, resilience, and automated security controls to ensure compliance and robust operation of sensitive research environments.
• Partner with Research, Data, and Applied teams to forecast capacity and cost for GPU and storage needs, setting quotas and streamlining ML experimentation pipelines.

Requirements

• **What makes you a great fit:**
• Proven experience leading the design, build, and operation of high-performance ML compute clusters at scale
• A proactive, autonomous approach to systems design and the proven ability and desire to ideate, co-create and implement optimal solutions
• Exposure to migrating or transforming ML infrastructure from traditional schedulers to modern, containerised systems
• Expertise with high-throughput storage systems for ML/HPC workloads
• Expert-level understanding of GPU architecture, high-speed networking for distributed training, and performance profiling to resolve bottlenecks
• A solid grasp of IaC and CI/CD practices (e.g., Terraform, Argo CD)
• **It would also be great if you had:**
• Experience with Lustre

Benefits

• **We offer the following salary and benefits:**
• Enhanced holiday pay
• Pension
• Life Assurance
• Income Protection
• Private Medical Insurance
• Hospital Cash Plan
• Therapy Services
• Perk Box
• Electric Car Scheme
• **Why work for EIT:**
• At the Ellison Institute, we believe a collaborative, inclusive team is key to our success. We are building a supportive environment where creative risks are encouraged, and everyone feels heard. We value emotional intelligence, empathy, respect, and resilience, and encourage people to be curious and to have a shared commitment to excellence. Join us and make an impact!