Research Scientist - Post-training / RL

Sorry, this job was removed at 06:38 p.m. (UTC) on Friday, Oct 16, 2026
Be an Early Applicant
San Francisco, CA, USA
In-Office
Junior
Healthtech • Software
The Role
Conduct research on post-training and reinforcement learning for multimodal medical imaging models. Develop reward systems, RLHF pipelines, reward models, grounded reasoning, tool use, inference-time optimization, and clinical report generation methods. Train large models on distributed infrastructure, diagnose reward hacking, and publish research establishing best practices for medical vision-language models.
Summary Generated by Built In
About Us

Epsilon Health is transforming medical imaging and diagnostics by bringing frontier AI into clinical practice. We're tackling some of healthcare's most critical challenges, building technology that directly improves patient outcomes.

This year, we've served over 300,000 patients and now serve 3,000+ daily, working with some of the largest medical institutions in the U.S. By year-end we will interpret 1% of all daily U.S. X-rays.

Our research team brings experience from DeepMind and Meta, powered by one of the industry's most comprehensive proprietary medical imaging datasets, continuously enriched by real-world clinical data. Together, we're building a future where frontier AI helps save millions of lives today, not tomorrow.

Recently out of stealth, we're proudly backed by Jack Altman, Uncork Capital, Renegade Partners, and AlleyCorp, one of NYC's most active healthcare venture firms.

Role Overview

We're seeking a Research Scientist with deep expertise in post-training and reinforcement learning to join our ML Research team. You'll be at the forefront of developing and deploying state-of-the-art multimodal models for clinical use in radiology settings. This role owns every stage after pretraining: supervised fine-tuning, reward modeling, reinforcement learning against verifiable and learned reward signals, reasoning and tool-use training, and inference-time strategy. You'll work with one of the largest and most diverse medical imaging datasets in the industry, advancing the state-of-the-art in grounded report generation, reward design, and inference-time reasoning while maintaining the clinical rigor required for healthcare deployment.

Key Responsibilities
  • Design reinforcement learning with verifiable rewards for report generation, including clinical label and entity-relation matching, grounding IoU, measurement accuracy, and reporting schema compliance.

  • Extend reinforcement learning to unverifiable and noisy objectives such as report quality and clinical usefulness, using learned reward models and radiologist feedback pipelines (RLHF) built on expert preferences and report edits.

  • Run GRPO-family algorithms with complex multi-reward objectives, tuning reward composition and diagnosing reward hacking, entropy collapse, and diversity loss.

  • Train explicit reward models, including multimodal reward models conditioned on the image, with both outcome and process supervision.

  • Train chain-of-thought reasoning over image regions, including evidence localization and verification loops that keep reasoning grounded in the image rather than in language priors.

  • Train multimodal tool use — windowing, zoom and crop, detector and segmentation calls, prior study retrieval — with credit assignment across multi-turn trajectories.

  • Develop inference-time methods including best-of-N sampling against reward models and grounding-aware decoding, and distill the resulting gains back into the policy.

  • Tune output stylization to institutional reporting conventions, keeping style rewards separated from clinical content rewards.

  • Stay current with cutting-edge research in reinforcement learning, reward modeling, and multimodal post-training.

  • Drive research and technical excellence through conference publications and technical blog posts, establishing best practices for post-training medical VLMs at scale.

Qualifications
  • 2+ years of academia/industry experience in reinforcement learning, post-training, or multimodal machine learning

  • Deep expertise in post-training large language or vision-language models (e.g., Qwen-VL, InternVL, LLaVA, or similar architectures)

  • Strong foundation in modern post-training and reinforcement learning techniques including:

    • Group-relative policy optimization and its successors (GRPO, DAPO, GSPO, CISPO) with multi-reward objectives

    • Reinforcement learning with verifiable rewards, and with noisy, sparse, or learned reward signals

    • Reward model training: pairwise and generative reward models, outcome and process supervision

    • Preference optimization methods (DPO, IPO, ORPO, KTO) and RLHF

    • Inference-time compute scaling, including best-of-N sampling and verifier-guided decoding

  • Practical experience diagnosing and mitigating reward hacking and reward over-optimization

  • Track record of implementing complex models from research papers and adapting them to new domains

  • Proficiency in PyTorch or JAX, with experience training large models on multi-GPU/distributed systems

  • Experience with reinforcement learning infrastructure at scale, including rollout generation (vLLM, SGLang) and frameworks such as verl, TRL, or OpenRLHF

  • Experience with autoregressive language modeling and instruction tuning

  • Strong software engineering skills and ability to write production-quality code

Preferred Qualifications
  • Publications at top-tier conferences (NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, MICCAI)

  • Hands-on experience with medical imaging applications, particularly radiology report generation

  • Experience with agentic or multi-turn reinforcement learning, including credit assignment over tool-use trajectories

  • Experience with grounded generation tasks (visual grounding, referring expression comprehension)

  • Knowledge of evaluation methodologies for long-form generation, including factuality assessment and hallucination detection

  • Experience mitigating catastrophic forgetting of supervised capabilities during reinforcement learning

  • Familiarity with clinical NLP and medical knowledge representation

  • Experience with model interpretability, explainability, and uncertainty quantification in safety-critical applications

Skills Required

  • 2+ years of academia or industry experience in reinforcement learning, post-training, or multimodal machine learning
  • Deep expertise in post-training large language or vision-language models
  • Expertise in GRPO, DAPO, GSPO, CISPO, and multi-reward objectives
  • Experience with reinforcement learning using verifiable, noisy, sparse, or learned reward signals
  • Experience training pairwise and generative reward models with outcome and process supervision
  • Experience with DPO, IPO, ORPO, KTO, and RLHF
  • Experience with inference-time compute scaling, best-of-N sampling, and verifier-guided decoding
  • Experience diagnosing and mitigating reward hacking and reward over-optimization
  • Track record implementing complex models from research papers and adapting them to new domains
  • Proficiency in PyTorch or JAX
  • Experience training large models using multi-GPU and distributed systems
  • Experience with large-scale reinforcement learning infrastructure, rollout generation, vLLM, SGLang, verl, TRL, or OpenRLHF
  • Experience with autoregressive language modeling and instruction tuning
  • Strong software engineering skills and ability to write production-quality code
  • Publications at top-tier conferences including NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, or MICCAI
  • Hands-on experience with medical imaging, particularly radiology report generation
  • Experience with agentic or multi-turn reinforcement learning and tool-use credit assignment
  • Experience with grounded generation, visual grounding, or referring expression comprehension
  • Knowledge of long-form generation evaluation, factuality assessment, and hallucination detection
  • Experience mitigating catastrophic forgetting during reinforcement learning
  • Familiarity with clinical NLP and medical knowledge representation
  • Experience with interpretability, explainability, and uncertainty quantification in safety-critical applications

Similar Jobs

Upside Logo Upside

Strategic Account Manager

Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Remote or Hybrid
USA
275 Employees
151K-180K Annually

TransUnion Logo TransUnion

Client Executive - Financial Services Sales

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Remote or Hybrid
2 Locations
13000 Employees
76K-126K Annually

CoreWeave Logo CoreWeave

Recruiter

Cloud • Information Technology • Machine Learning
In-Office
6 Locations
1450 Employees

CoreWeave Logo CoreWeave

Executive Assistant

Cloud • Information Technology • Machine Learning
In-Office
Sunnyvale, CA, USA
1450 Employees
108K-143K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees
Year Founded: 2024

What We Do

Epsilon Health exists to solve the looming global radiology crisis before it reshapes patient care. Radiology underpins nearly every medical specialty, yet it is one of the most strained parts of the healthcare system. We’re rethinking how imaging and interpretation work to make radiology faster, more reliable, and future-proof.

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account