Product Manager - Dedicated Inference

Reposted 15 Days Ago
2 Locations
Hybrid
200K-285K Annually
Mid level
Software
The Role
As a Core Product Manager, you will shape the developer experience for AI applications, driving the roadmap for APIs, UI, and workflows, while collaborating with design and engineering teams.
Summary Generated by Built In

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

As a Product Manager, Dedicated Inference at Baseten, you’ll shape the core developer experience that powers how users build, deploy, and manage AI applications on our platform. You’ll drive the roadmap for user-facing APIs, SDKs, UI workflows, and integration surfaces, turning complex ML infrastructure into a seamless, intuitive product. Your work will directly impact how teams interact with Baseten day-to-day, ensuring that our platform is both powerful and a joy to use.

EXAMPLE INITIATIVES

  • Chains for multi-component workflows

  • Asynchronous inference

  • Model APIs for frontier models

  • Model training built for production inference

RESPONSIBILITIES

  • Own the roadmap for Baseten’s core product surface, including APIs, UI, and developer workflows

  • Partner with design and engineering to deliver elegant, intuitive developer experiences

  • Collaborate with customers to deeply understand pain points and define solutions that simplify AI deployment

  • Drive new product launches and improve onboarding, observability, and management experiences

  • Align product initiatives with company strategy and ensure measurable product adoption and retention

REQUIREMENTS

  • 4+ years of Product Management experience in developer tools, SaaS, or ML platforms

  • Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer)

  • Deep empathy for developers and an ability to translate technical complexity into simple, usable products

  • Experience driving cross-functional alignment across design, engineering, and GTM teams

  • Proven ability to define product success metrics and iterate based on data and feedback

NICE TO HAVE

  • Familiarity with AI/ML workflows and inference products

  • Experience building products for technical users (e.g., APIs, SDKs, dashboards)

  • Background in developer experience or product-led growth

BENEFITS

  • Competitive compensation, including meaningful equity.

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Skills Required

  • 4+ years of Product Management experience in developer tools, SaaS, or ML platforms
  • Degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer
  • Experience driving cross-functional alignment across design, engineering, and GTM teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
59 Employees

What We Do

At Baseten we provide all the infrastructure you need to deploy and serve ML models performantly, scalably, and cost-efficiently. Get started in minutes, and avoid getting tangled in complex deployment processes. You can deploy best-in-class open-source models and take advantage of optimized serving for your own models. We also utilize horizontally scalable services that take you from prototype to production, with light-speed inference on infra that autoscales with your traffic. Best in class doesn't mean breaking the bank. Run your models on the best infrastructure without running up costs by taking advantage of our scaled-to-zero feature

Similar Jobs

Chime Logo Chime

Data Analyst

Fintech • Machine Learning • Mobile • Security • Software
Easy Apply
Hybrid
3 Locations
1500 Employees
152K-210K Annually

Samsara Logo Samsara

Director, Sales Finance

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
135K-241K Annually

Zeta Global Logo Zeta Global

Senior Analyst, Analytics and Insights (Programmatic)

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
New York, NY, USA
2429 Employees
90K-110K Annually

Hex Logo Hex

Manager, Mid-Market Sales

Artificial Intelligence • Big Data • Software • Analytics • Business Intelligence • Big Data Analytics
Remote or Hybrid
2 Locations
160 Employees
280K-320K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account