Hybrid Software Engineer, AI Gateway

Posted last week

Apply now

About the role

  • Software Engineer developing and improving AI Gateway platform for Vercel. Collaborating with teams to ensure production-ready reliability for AI workloads.

Responsibilities

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

Requirements

  • You have at least 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment.

Benefits

  • Competitive compensation package, including equity.
  • Inclusive Healthcare Package.
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
  • Flexible Time Off.
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

Job title

Software Engineer, AI Gateway

Job type

Experience level

Mid levelSenior

Salary

$196,000 - $294,000 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job