Hybrid Senior Principal MLOps Engineer, AI Inference

Posted last month

Apply now

About the role

  • Build and release the Red Hat AI Inference runtimes and continuously improve processes and tooling used by the DevOps team
  • Work closely with product and research teams to scale SOTA deep learning products and software for enterprise deployments
  • Create and manage model training and deployment pipelines
  • Create DevOps and CI/CD infrastructure and scale the current technology stack
  • Actively contribute to managing and releasing upstream and midstream product builds
  • Test to ensure correctness, responsiveness, and efficiency
  • Troubleshoot, debug and upgrade Dev & Test pipelines
  • Identify and deploy cybersecurity measures via continuous vulnerability assessment and risk management
  • Collaborate with cross-functional teams on market requirements and best practices
  • Keep abreast of the latest technologies and standards in the field

Requirements

  • 2+ years of experience in MLOps, DevOps, Automation and modern Software Deployment practices
  • Strong experience with Git, Github Actions including self-hosted runners, Terraform, Jenkins, Ansible, and common technologies for automation and monitoring
  • Highly experienced with administering Kubernetes/Openshift
  • Familiar with Agile development methodology
  • Experience with Cloud Computing using at least one of the following: AWS, GCP, Azure, or IBM Cloud
  • Solid programming skills especially in Python
  • Solid troubleshooting skills
  • Experience maintaining an infrastructure and ensuring stability
  • Ability to interact comfortably with members of a large, geographically dispersed team
  • Familiarity with contributing to the vLLM CI community is a big plus
  • While a Bachelor’s degree or higher in computer science, mathematics, or a related discipline is valued, technical prowess, initiative, problem solving, and practical experience are prioritized

Benefits

  • Comprehensive medical, dental, and vision coverage
  • Flexible Spending Account - healthcare and dependent care
  • Health Savings Account - high deductible medical plan
  • Retirement 401(k) with employer match
  • Paid time off and holidays
  • Paid parental leave plans for all new parents
  • Leave benefits including disability, paid family medical leave, and paid military leave
  • Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more
  • Possibility of bonus, commission, and/or equity
  • Flexible work arrangements (in-office, office-flex, or fully remote depending on role)

Job title

Senior Principal MLOps Engineer, AI Inference

Job type

Experience level

Senior

Salary

$189,600 - $312,730 per year

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job