Hybrid Senior/Staff Backend Engineer – Distributed System

Posted 2 months ago

Apply now

About the role

  • Backend Engineer building systems for GPU clusters in AI workloads. Design APIs and optimize resource management for AI infrastructure.

Responsibilities

  • Design APIs that abstract complex GPU operations into simple developer experiences
  • Build scheduling algorithms that maximize GPU utilization while ensuring SLA compliance
  • Develop resource management systems for GPU lifecycle—provisioning, allocation, scheduling, and release
  • Create usage tracking and billing systems for GPU-hours, memory usage, and compute utilization
  • Implement monitoring for GPU-specific metrics, health checks, and automatic failure recovery
  • Build multi-tenancy systems with resource isolation, quota management, and fair scheduling
  • Optimize cold starts for model serving and implement efficient model loading strategies
  • Collaborate with frontend engineers to expose complex infrastructure through intuitive interfaces
  • Leverage AI-assisted coding tools (GitHub Copilot, Claude Code, Cursor IDE, etc.) to boost productivity and code quality.

Requirements

  • 5+ years backend engineering experience with distributed systems
  • Strong proficiency in Go, Python, or similar backend languages
  • Experience with resource scheduling, orchestration, and API design (REST, GraphQL, gRPC)
  • Understanding of hardware constraints and system optimization
  • Linux systems knowledge and containerization experience (Docker, Kubernetes)
  • Comfortable working with expensive resources where efficiency directly impacts costs
  • Excited about solving novel problems in AI infrastructure (not just another CRUD app)
  • Startup mindset—comfortable with ambiguity and rapid iteration
  • GPU or HPC cluster management experience (bonus)
  • Understanding of ML/AI workload patterns and requirements (bonus)
  • Experience with high-value resource allocation systems (bonus)
  • Background in performance optimization for compute-intensive workloads (bonus)
  • Familiarity with GPU virtualization and sharing technologies (bonus)
  • Experience building billing or metering systems (bonus)

Benefits

  • competitive salary
  • meaningful equity
  • 3 days in office, 2 days WFH

Job title

Senior/Staff Backend Engineer – Distributed System

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job