Vercel Logo

Vercel

Software Engineer, AI Gateway

Reposted 2 Days Ago
Easy Apply
Hybrid
New York, NY, USA
196K-294K Annually
Senior level
Easy Apply
Hybrid
New York, NY, USA
196K-294K Annually
Senior level
Develop and enhance AI Gateway platform, contributing to the design and maintenance of features for optimal reliability in AI workloads while collaborating with cross-functional teams.
The summary above was generated by AI
About Vercel:

Vercel is the agentic infrastructure company. We free people and agents to ship what’s next.


For more than a decade, Vercel has shaped how the web is built. As the team behind Next.js, v0, and AI SDK, we create products that help builders move from idea to production with speed, security, and exceptional developer experience.


Now, software is entering a new era, and the next generation of products will not just be used by people. They will be built, extended, and operated by agents.


We are building the platform for that future, trusted by companies like OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide. Whether you’re building our products, supporting our customers, growing our community, or shaping our story, you’ll help define what comes next.

About the Role:
As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
 
What You Will Do:
  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
About You:
  • You have at least 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment
Benefits:
  • Competitive compensation package, including equity.
  • Inclusive Healthcare Package.
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
  • Flexible Time Off.
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.
Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.

Vercel New York, New York, USA Office

47th Street, New York, NY, United States, 10036

Similar Jobs at Vercel

2 Days Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
196K-294K Annually
Senior level
196K-294K Annually
Senior level
Artificial Intelligence • Cloud • Software
As a Software Engineer on the Workflows Team, you'll develop the Workflow Development Kit and platform, emphasizing AI integrations, durability, and observability while collaborating with cross-functional teams and engaging with the open-source community.
Top Skills: AIFrontend Development ToolsJavaScriptMlTypescript
2 Days Ago
Easy Apply
Remote or Hybrid
New York, NY, USA
Easy Apply
137K-207K Annually
Senior level
137K-207K Annually
Senior level
Artificial Intelligence • Cloud • Software
The Forward-Deployed Engineer will modernize frontend applications, lead migrations to Next.js, architect high-performance applications, build AI solutions, and engage with enterprise customers to deliver measurable business value.
Top Skills: Ai SdkCore Web VitalsEdge FunctionsIncremental Static Regeneration (Isr)LlmsNext.JsReactServer ComponentsTypescript
2 Days Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
216K-270K Annually
Senior level
216K-270K Annually
Senior level
Artificial Intelligence • Cloud • Software
The Senior Partner Manager at Vercel manages strategic partner relationships, executes partnership strategies, drives revenue growth, and fosters executive-level connections for mutual success.
Top Skills: AIDeveloper ToolingSaaS

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account