Machine Learning Engineer

Sorry, this job was removed at 02:49 a.m. (UTC) on Thursday, Sep 10, 2026
Menlo Park, CA, USA
In-Office
Entry level
Artificial Intelligence • Healthtech
The Role
Build reliable training, evaluation, deployment, and data-feedback pipelines for a recursively self-improving machine learning system. Design reward and feedback signals, mitigate reward hacking and distribution drift, develop evaluation harnesses, debug model regressions, stabilize non-stationary learning loops, and ship production ML systems. The role requires strong Python and machine learning engineering fundamentals, reinforcement learning knowledge, production experience, and familiarity with feedback-driven systems such as RLHF, RLAIF, active learning, or agent evaluation.
Summary Generated by Built In
About the role

We are building a recursive self-improvement system — a machine learning system that iteratively improves itself through feedback, evaluation, and automated learning loops. You will help build the engineering pipeline that keeps these loops fast, reliable, and trustworthy: the training and evaluation pipelines, the reward and feedback signals, and the safeguards that prevent a self-improving system from silently degrading or gaming its objectives.

This is an engineering-first role with deep reinforcement learning requirements. You should be equally comfortable writing robust production ML code and reasoning about reward design, credit assignment, and why feedback-driven systems become unstable.

What you'll do
  • Build and maintain the training, evaluation, and deployment loops at the core of the self-improvement system, with a strong emphasis on reproducibility and reliability.

  • Design and implement reward and feedback signals; investigate and mitigate reward hacking, specification gaming, and distribution drift.

  • Build evaluation harnesses and metrics before models — because a self-improving system is only as safe as its measurement of “better.”

  • Own data pipelines and automated data flywheels that feed the learning loop.

  • Debug subtle model-quality regressions and stabilize training and feedback loops that go non-stationary.

  • Collaborate with research and product to turn methods into robust, shippable systems.

What we're looking for

Must-Haves:

Strong MLE fundamentals (non-negotiable)

  • Excellent Python and clean, well-tested ML training code.

  • Solid grasp of data pipelines, distributed / large-scale training, and experiment tracking.

  • The instinct and skill to debug why a model silently got worse — not just why it crashed.

Hands-on experience with a feedback or learning loop (at least one).

  • Built or owned part of a feedback loop — a reward model, an evaluation harness, or the data pipeline for an RLHF/RLAIF or active-learning system.

  • Ran a retraining or continual-learning pipeline where a model consumed its own predictions or production data (e.g. ranking, recommendations, fraud, spam).

  • Fine-tuned LLMs with human or AI feedback, or built agentic evaluation harnesses.

Reinforcement learning foundations and curiosity.

  • Working knowledge of reward modeling, on-policy vs. off-policy tradeoffs, and credit assignment (does not need to be a research-level RL expert).

  • Has seen — or can reason clearly about — feedback-system failure modes: reward hacking, specification gaming, feedback loops amplifying errors.

  • Comfortable evaluating non-stationary systems (systems whose behavior and data distribution change over time).

Systems and evaluation instinct.

  • Builds the eval before the model; treats measurement as a first-class deliverable.

  • Has shipped an ML system into production and kept it healthy over time.

Strongest signal

Bonus, not required:

The ideal candidate has built or shipped a full system that improved from its own outputs or feedback end to end. This is rare at this level, so treat it as a standout differentiator rather than a filter. Examples:

  • RLHF / RLAIF pipelines

  • Self-play systems

  • Active-learning loops

  • Automated data flywheels

  • Agentic evaluation harnesses

Nice to Have:

  • PhD or MS in RL / ML paired with real production experience (either the science or the engineering half alone is fine if the other is strong).

  • Experience at a lab or company doing RLHF, agents, or large-scale ML infrastructure.

  • Familiarity with LLM fine-tuning, evaluation frameworks, or agent orchestration.

Why Join Hippocratic AI

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Equal Opportunity

Hippocratic AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity or expression, genetic information, military or veteran status, or any other characteristic protected by applicable law. We are committed to building a team that reflects the patients we serve. We actively encourage applications from candidates of all backgrounds. If you require accommodations during the hiring process, please contact [email protected].

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.

Skills Required

  • Excellent Python programming and clean, well-tested machine learning training code
  • Experience with data pipelines, distributed or large-scale training, and experiment tracking
  • Ability to diagnose silent model-quality regressions and production ML issues
  • Hands-on experience building or owning a feedback or learning loop
  • Experience with reward models, evaluation harnesses, RLHF/RLAIF, active learning, continual learning, or production feedback pipelines
  • Working knowledge of reinforcement learning, reward modeling, on-policy and off-policy learning, and credit assignment
  • Understanding of reward hacking, specification gaming, feedback loops, and non-stationary systems
  • Experience building evaluation and measurement systems
  • Experience shipping and maintaining a machine learning system in production
  • Experience building an end-to-end system that improves from its own outputs or feedback
  • PhD or MS in reinforcement learning or machine learning paired with production experience
  • Experience at a lab or company focused on RLHF, agents, or large-scale machine learning infrastructure
  • Familiarity with LLM fine-tuning, evaluation frameworks, or agent orchestration

Similar Jobs

General Motors Logo General Motors

Machine Learning Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
Mountain View, CA, USA
165000 Employees

General Motors Logo General Motors

Machine Learning Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
4 Locations
165000 Employees
219K-335K Annually

True Anomaly Logo True Anomaly

Machine Learning Engineer

Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
In-Office
2 Locations
300 Employees
125K-220K Annually

True Anomaly Logo True Anomaly

Machine Learning Engineer

Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
In-Office
2 Locations
300 Employees
125K-220K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, California
97 Employees
Year Founded: 2023

What We Do

Hippocratic AI’s mission is to develop the first safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health. The company was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Microsoft, Meta and NVIDIA. Hippocratic AI has received a total of $137 million in funding and is backed by leading investors, including General Catalyst, Andreessen Horowitz, Premji Invest, SV Angel, NVentures (Nvidia Venture Capital), and Greycroft. For more information on Hippocratic AI: www.HippocraticAI.com.

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account