Software Engineer developing and improving AI Gateway platform for Vercel. Collaborating with teams to ensure production-ready reliability for AI workloads.
Responsibilities
Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
Requirements
You have at least 5+ years of relevant experience
Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
Experience contributing to or participating in open source projects
Excellent communication skills and the ability to work effectively in a collaborative team environment.
Benefits
Competitive compensation package, including equity.
Inclusive Healthcare Package.
Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
Flexible Time Off.
We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
Senior Software Developer leading the design and implementation of software solutions for defense and mission - critical applications. Involves full lifecycle development and adherence to quality and security standards.
Fullstack Engineer developing scalable, AI - powered microservices. Working with an interdisciplinary team on a job advertising platform in Hamburg with hybrid flexibility.
Senior Specialty Software Engineer developing large - scale enterprise applications using Pega technology. Collaborating with cross - functional teams in an agile environment to enhance performance and maintainability.
Senior Specialty Software Engineer developing large - scale enterprise applications using Pega technology at Wells Fargo. Collaborating with cross - functional teams in an agile environment.
Regional Staff Engineer responsible for planning and building infrastructure at Intel's sites in EMEA. Manage projects, ensure compliance, and drive operational efficiency.
Associate Product Engineer at Pass the Keys focusing on product - driven software solutions with AI - augmented tools supporting a user - friendly approach in property management.
Teaching Assistant for AI Software Engineering Bootcamp at Digitale Leute School, responsible for mentoring and supporting participants in their learning journey.
Software Development Engineering role at Western Digital for validating products through automation and internal applications. Collaborate with engineering teams to enhance product quality and efficiency.
IT - Consultant working on Linux/Red Hat OpenShift for DATAGROUP, supporting client IT environments. Responsible for concept and operation of OpenShift environments in a team setting.
Sr. Software Engineer designing, coding, and debugging lottery systems at Scientific Games. Collaborating in requirements gathering, supporting production systems, and adhering to development standards.