Product Manager – AI and Apps Platform

Hippocratic AI is the leading generative AI company in healthcare. We have the only system that can have safe, autonomous, clinical conversations with patients. We have trained our own LLMs as part of our Polaris constellation, resulting in a system with over 99.9% accuracy.

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Location Requirement

We believe the best ideas happen together. To support fast collaboration and a strong team culture, this role is expected to be in our Palo Alto office five days a week, unless otherwise specified.

We are seeking a Product Manager – AI and Apps Platform to define the vision, roadmap, and execution for the systems powering our large language and audio models, inference clusters, and SaaS applications across multiple clouds.

You’ll partner closely with engineering, AI research, and GTM teams to build a scalable, cost-efficient, and extensible platform for model training, deployment, and application hosting. This role blends product strategy, technical depth, and cross-team leadership to ensure the platform enables rapid innovation and operational excellence at scale.

• Define and execute the roadmap for HippocraticAI’s cross-cloud AI and application platform.

• Partner with engineering and research on capacity planning for inference and application clusters.

• Maintain model capacity and utilization tracking across LLM and Audio workloads.

• Coordinate with GTM on deployment strategy, onboarding, and demand forecasting.

• Collaborate with cloud vendors on capacity, pricing, and new feature evaluation.

• Build and refine cost-optimal platform to balance performance and margins.

• Lead pricing and margin analysis to align product performance with business goals.

• Define and track success metrics around latency, cost, utilization, and adoption.
  

Must-Have:

• 7+ years of product management experience, with at least 2+ years in AI/ML platform or infrastructure products.

• Strong technical understanding of model training, inference, and cloud compute architectures (AWS, GCP, or Azure).

• Proven ability to align engineering, research, and GTM teams around shared goals.

• Experience with capacity planning, cost optimization, and multi-cloud infrastructure.

• Knowledge of cloud economics, performance trade-offs, and observability frameworks.

• Excellent communication and analytical skills, with a focus on measurable outcomes.
  

Nice-to-Have:

• Hands-on background in cloud infrastructure, MLOps, or distributed systems.

• Experience with GPU orchestration, multi-cloud cost optimization, or AI inference workloads.

• Familiarity with LLM and voice-agent technologies.

• Passion for building platforms that empower both developers and customers.
  

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.