Hybrid Machine Learning Engineer II, AI/ML Infrastructure, GenAI Platforms

Posted last month

Apply now

About the role

  • Machine Learning Engineer II working on GenAI infrastructure for Zendesk. Collaborating with teams on AI deployments and focusing on ML systems and applications.

Responsibilities

  • Contribute to the development of Zendesk’s LLM Proxy, enabling secure, cost-optimized access to multiple foundation models.
  • Help develop and maintain benchmarking and A/B testing frameworks for measuring LLM performance, latency, and cost.
  • Assist in building orchestration systems that enable multi-step, tool-using AI agents.
  • Work closely with applied ML, product, and platform teams to ensure infrastructure meets product needs.
  • Deliver well-tested, maintainable, and performant code ready for production deployment.

Requirements

  • 2–4 years of hands-on experience developing and deploying ML systems or infrastructure.
  • Familiarity with LLM applications, vector databases, or ML/AI infrastructure components.
  • Exposure to AWS, GCP, or Azure; understanding of Kubernetes, Docker, or similar containerized environments.
  • Proficiency in Python and familiarity with at least one other backend language (Java, Scala, Golang, or Ruby).
  • Understanding of CI/CD workflows, testing frameworks, and software design principles.
  • Ability to work effectively in cross-functional teams and take feedback constructively.

Benefits

  • Full ownership of the projects you work on.
  • Flexible working hours.
  • Professional development funds.
  • Comfortable office and a remote setup.
  • Choice of your laptop and other equipment.
  • Premium Medical Insurance as well as Private Life Assurance.

Job title

Machine Learning Engineer II, AI/ML Infrastructure, GenAI Platforms

Job type

Experience level

JuniorMid level

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job