Hybrid Software Engineer, ML Platform – ML Serving

at Zoox

• Job title: Software Engineer, ML Platform – ML Serving
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: $189,000 - $258,000 per year
• Degree requirement: Bachelor's Degree
• Tech skills: AWS, Cloud, Kubernetes, PyTorch
• Location requirements: Hybrid, Foster City, United States

About the role

• Software Engineer in ML Platform developing infrastructure for ML use cases in autonomous driving. Collaborating cross-functionally to enhance machine learning practices at Zoox.

Responsibilities

• Build the off-vehicle inference service powering our Foundational models (LLMs & VLMs) and the models that improve our rider experiences.
• Lead the design, implementation, and operation of a robust and efficient ML serving infrastructure to enable the serving and monitoring of ML models.
• Collaborate closely with cross-functional teams, including ML researchers, software engineers, and data engineers, to define requirements and align on architectural decisions.
• Enable the junior engineers in the team to grow their careers by providing technical guidance and mentorship

Requirements

• 4+ years of ML model serving infrastructure experience
• Experience building large-scale model serving using GPU and/or high QPS, low latency serving use cases.
• Experience with GPU-accelerated inference using RayServe, vLLM, TensorRT, Nvidia Triton, or PyTorch.
• Experience working with cloud providers like AWS and working with K8s

Benefits

• Health insurance
• Long-term care insurance
• Long-term and short-term disability insurance
• Life insurance
• Paid time off (e.g. sick leave, vacation, bereavement)
• Unpaid time off
• Zoox Stock Appreciation Rights
• Amazon Restricted Stock Units (RSUs)