Software Engineer developing and improving AI Gateway platform for Vercel. Collaborating with teams to ensure production-ready reliability for AI workloads.
Responsibilities
Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
Requirements
You have at least 5+ years of relevant experience
Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
Experience contributing to or participating in open source projects
Excellent communication skills and the ability to work effectively in a collaborative team environment.
Benefits
Competitive compensation package, including equity.
Inclusive Healthcare Package.
Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
Flexible Time Off.
We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
Senior Fullstack developer at SEB developing AI product in cloud data portfolio. Collaborating with teams to deliver exceptional results in Investment Advice area.
Full Stack Developer developing critical systems supporting Post trade management at SEB. Collaborating within an agile team to innovate for a sustainable financial future.
Junior Software Engineer at Hedvig developing innovative insurance products and collaborating closely with cross - functional teams while working with modern technologies.
Engineering Lead leading a squad of engineers to develop the Digital Twin Platform at Woven by Toyota. Engaging with customers and ensuring quality deliverables in a hybrid environment.
Freelance Embedded Software Engineer developing hardware products at Kickmaker. Engaging in firmware design, software development, and international project participation.
Junior Fullstack Developer at Etinet responsible for frontend and backend development. Collaborating with teams to build scalable and high - performance digital solutions.
Senior Software Engineer in the STIX team protecting payment flows through credit assessments and fraud detection. Running a microservices architecture and processing credit checks daily.
Lead Software Engineer at Novacura focusing on developing IFS Cloud software solutions and supporting projects. Engage with customers and teams to implement successful software solutions in a dynamic environment.
Software Engineer developing innovative, high - performance solutions in customer - centric feature teams. Collaborating with engineers and analysts to produce complex software rapidly.