Engineering Manager, Cloud Platform

Reposted 17 Days Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
165K-330K Annually
Senior level
Software
Inference will be the largest market ever created.
The Role
Manage and grow a cloud platform team building scalable, reliable production infrastructure. Drive technical decisions, own deployments/monitoring/incident response, set standards for operational excellence, align infrastructure with product priorities, and recruit and develop engineers.
Summary Generated by Built In

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

As the Engineering Manager for Baseten's Cloud Platform team, you will directly manage a team of cloud platform engineers responsible for building the systems and processes that keep our infrastructure scalable, reliable, and efficient — from automated deployments and monitoring to performance optimization and incident response.

You are a people-first leader with a strong cloud infrastructure background. You set a high bar for reliability and operational excellence, engage credibly in technical discussions and code reviews, and know how to build a culture of ownership and accountability. You'll spend most of your time close to the work: unblocking your team, shaping technical direction on day-to-day decisions, and developing your engineers. At Baseten, we work closely with our users to understand their struggles operationalizing ML — you'll keep your team connected to that mission and translate user learnings into better infrastructure.

 

RESPONSIBILITIES

  • Recruit, hire, and grow a high-performing team of cloud platform engineers; provide ongoing coaching, feedback, and career development through regular 1:1s.

  • Set clear performance expectations, hold a high bar, and create an environment where engineers do their best work.

  • Foster a culture of ownership, accountability, and continuous improvement.

  • Drive day-to-day technical decisions through design reviews, code reviews, and architectural discussions; translate the infrastructure roadmap into clear team priorities and milestones, and hold execution against them.

  • Establish standards and best practices for reliability, performance, and operational excellence; ensure the team owns projects end-to-end, from specification through production.

  • Exercise and encourage good judgment on tooling and architectural tradeoffs, with a bias against unnecessary complexity.

  • Partner with product and engineering teams to align infrastructure work with business priorities; represent your team's progress, capacity, and technical tradeoffs clearly to leadership.

  • Serve as the escalation point for major incidents; drive resolution with urgency, ensure the team learns systematically, and stay connected to users so those learnings feed back into infrastructure improvements.

 

REQUIREMENTS

  • Proven experience directly managing engineers in a cloud infrastructure, platform engineering, or SRE context (not managing managers).

  • Extensive hands-on experience with Kubernetes, with the ability to engage credibly in architectural discussions and code reviews.

  • Strong background building and maintaining scalable, production infrastructure.

  • Familiarity with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, CircleCI, Jenkins).

  • Demonstrated ability to drive projects end-to-end — from specification to execution — and coach your team to do the same.

  • Strong written and verbal communication skills; able to influence across teams without direct authority.

  • Track record of recruiting and growing engineering talent.

  • Openness to learning about ML infrastructure; prior machine learning experience is not required.

 

NICE TO HAVE

  • Experience with OSS observability tooling (Prometheus, ELK stack, Grafana, OpenTelemetry).

  • Background in multi-cloud environments or GPU infrastructure.

  • Experience building and managing on-call rotations and incident response processes.

BENEFITS

  • Competitive compensation, including meaningful equity.

  • 100% coverage of medical, dental, and vision insurance for employee and dependents

  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

  • Paid parental leave

  • Fertility and family-building stipend through Carrot

  • Company-facilitated 401(k)

  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Skills Required

  • Proven experience directly managing engineers in a cloud infrastructure, platform engineering, or SRE context (not managing managers).
  • Extensive hands-on experience with Kubernetes, with the ability to engage credibly in architectural discussions and code reviews.
  • Strong background building and maintaining scalable, production infrastructure.
  • Familiarity with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi).
  • Familiarity with CI/CD tooling (e.g., GitHub Actions, GitLab CI, CircleCI, Jenkins).
  • Demonstrated ability to drive projects end-to-end -- from specification to execution -- and coach your team to do the same.
  • Strong written and verbal communication skills; able to influence across teams without direct authority.
  • Track record of recruiting and growing engineering talent.
  • Openness to learning about ML infrastructure; prior machine learning experience is not required.
  • Experience with OSS observability tooling (Prometheus, ELK stack, Grafana, OpenTelemetry).
  • Background in multi-cloud environments or GPU infrastructure.
  • Experience building and managing on-call rotations and incident response processes.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
350 Employees
Year Founded: 2019

What We Do

AI’s future won’t be a few massive models built by a handful of labs. It’ll be millions of specialized models embedded into every product, workflow, and experience by the people closest to the customer. The foundation of that future is inference. Inference determines the performance, reliability, latency, and economics of every AI product. For AI to scale globally, it must be as reliable, fast, cost-effective, and high-quality as possible. That’s why Baseten exists. Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.

Why Work With Us

We’re an interdisciplinary team of researchers, engineers, and operators building the Inference Cloud our AI future demands. We’re running at a hard systems problem that requires first-principles thinking across the entire stack. The bar is high. We work hard, move fast, and care deeply about quality.

Similar Jobs

In-Office
2 Locations
72000 Employees
173K-286K Annually

Valon Logo Valon

Engineering Manager

Fintech • Real Estate
Remote or Hybrid
2 Locations
500 Employees
242K-284K Annually

MongoDB Logo MongoDB

Senior Data Analyst

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
United States
5550 Employees
83K-162K Annually

CrowdStrike Logo CrowdStrike

Consultant

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
2 Locations
10000 Employees
85K-120K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account