Software Engineer, AI Gateway

Reposted 2 Months Ago
Easy Apply
San Francisco, CA, USA
Hybrid
196K-294K Annually
Senior level
Artificial Intelligence • Cloud • Software
Vercel is the platform where humans and AI agents build, ship, and scale software together.
The Role
Develop and enhance AI Gateway platform, contributing to the design and maintenance of features for optimal reliability in AI workloads while collaborating with cross-functional teams.
Summary Generated by Built In
About Vercel:

Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.

Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.

 
About the Role:
As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
 
What You Will Do:
  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
About You:
  • 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment
Benefits & Compensation:
  • Competitive compensation package, including equity.
  • Inclusive Healthcare Package.
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
  • Flexible Time Off.
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.

#LI-KR1

Disclosures:
  • Privacy: Please review our Job Applicant Privacy Policy for more information on how we handle your data.
  • Equal Opportunity: Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.

Skills Required

  • 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript
  • Experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, and distributed systems
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and ability to work in a collaborative team

What the Team is Saying

Logan Liffick
Jay Gengelbach
Jeanne Dewitt Grosser
Logan Liffick
Jay Gengelbach
Logan Liffick
Logan Liffick
Guillermo Rauch
Guillermo Rauch
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
Year Founded: 2015

What We Do

From solo developers building their first app to large enterprise teams if it needs to be fast, reliable, and beautifully built, it runs on Vercel. Our platform powers millions of deployments a day. We started with a simple belief: the web should be fast for everyone, everywhere. That belief became Next.js. Then a platform. Then the infrastructure layer for the AI-native web. We are backed by the amazing team at Accel and CRV, and we're headquartered in San Francisco.

Vercel Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Vercel is a remote-friendly company. Some roles are in-office (SF, NYC and others), and some are fully remote. For the right candidate, flexible arrangements are available, supported by home office and wellness stipends.

Typical time on-site: Flexible
Company Office Image
HQSan Francisco, CA
Company Office Image
London, England
Company Office Image
Austin, TX
Company Office Image
Berlin, Germany
Company Office Image
New York, NY
Learn more

Similar Jobs

Vercel Logo Vercel

Senior Accountant

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
San Francisco, CA, USA
120K-140K Annually

Vercel Logo Vercel

People Systems Manager, Workday

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
San Francisco, CA, USA
167K-204K Annually

Vercel Logo Vercel

Machine Learning Engineer

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
2 Locations
208K-312K Annually

Vercel Logo Vercel

Enterprise Account Executive

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
3 Locations
280K-320K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account