ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
This role sits at the applied end of our post-training research efforts. You will work directly with stakeholders from the world’s fastest-growing AI companies to post-train open-source models that outperform frontier closed models on their specialised tasks. Your day-to-day is finding creative ways to extract signal from complex, domain-specific datasets and building the reward functions, environments, eval harnesses, and training pipelines that turn that signal into better models. The models you train ship to production and reach millions of users.
We are looking for people with hands-on LLM fine-tuning and RL experience. Researchers who are excited by the prospect of shipping models into production, who can translate a customer's domain-specific requirements into an effective training curriculum, and who know when to be rigorous and when to iterate fast.
RECENT RESEARCH
Dense, on-policy or both?
Repeated kv cache for long-running agents
Distillation without the dark – replicating black-box on-policy distillation on Baseten
RESPONSIBILITIES
Design and run post-training pipelines: SFT, GRPO, DPO, RLVR, reward function engineering, and synthetic data generation.
Build task-specific training environments and evals tailored to customer domains like healthcare, code generation, and legal, spanning multi-turn tool use, sandboxed execution, and agentic workflows.
Work directly with customers to translate production data into training signal, designing reward loops from real usage patterns and handling distribution shift.
Run and analyze training experiments end-to-end: diagnose reward hacking, importance sampling drift, and advantage estimation instabilities.
Publish findings at top venues and contribute to Baseten's open-source training libraries.
QUALIFICATIONS
Hands-on experience training LLMs with reinforcement learning — demonstrated understanding of GRPO or PPO beyond recipe-level reproduction, including group advantage computation, clipped objectives, and KL penalty design
Strong intuition for reward engineering: the ability to distinguish between a reward that trains effectively and one that will exploit at scale
Experience building multi-turn agent environments with tool use, not limited to single-turn question-answering setups
Comfort working across the full pipeline from dataset construction through training, evaluation, and deployment
Experience with production ML systems. Preference for candidates who have closed a training–inference loop where production data feeds back into model improvement
PREFERRED QUALIFICATIONS
Experience with RL training frameworks
Publications at NeurIPS, ICML, ICLR, focused on RL for LLMs, reward modeling, or alignment
BENEFITS
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Skills Required
- Hands-on experience training large language models with reinforcement learning, including GRPO or PPO, group advantage computation, clipped objectives, and KL penalty design
- Strong reward engineering intuition, including distinguishing effective training rewards from rewards that can be exploited at scale
- Experience building multi-turn agent environments with tool use
- Comfort working across dataset construction, training, evaluation, and deployment
- Experience with production machine learning systems
- Experience closing a training-inference loop using production data for model improvement
- Experience with reinforcement learning training frameworks
- Publications at NeurIPS, ICML, or ICLR focused on reinforcement learning for LLMs, reward modeling, or alignment
Baseten Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Baseten and has not been reviewed or approved by Baseten.
-
Fair & Transparent Compensation — Feedback suggests pay targets the top of market with explicit ranges in postings and a stated aim to provide 90th percentile salaries with equity. Role descriptions emphasize competitive, experience-based pay bands and meaningful stock grants.
-
Healthcare Strength — Healthcare is described as fully covered for medical, dental, and vision for employees and their families, reducing out-of-pocket costs. This comprehensive coverage is consistently highlighted alongside other core benefits.
-
Leave & Time Off Breadth — Time off policies include unlimited PTO with a minimum expectation of at least four weeks, 16 paid company holidays, and a company-wide winter break. These elements indicate substantial protected time away from work.
Baseten Insights
What We Do
AI’s future won’t be a few massive models built by a handful of labs. It’ll be millions of specialized models embedded into every product, workflow, and experience by the people closest to the customer. The foundation of that future is inference. Inference determines the performance, reliability, latency, and economics of every AI product. For AI to scale globally, it must be as reliable, fast, cost-effective, and high-quality as possible. That’s why Baseten exists. Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
Why Work With Us
We’re an interdisciplinary team of researchers, engineers, and operators building the Inference Cloud our AI future demands. We’re running at a hard systems problem that requires first-principles thinking across the entire stack. The bar is high. We work hard, move fast, and care deeply about quality.
.png){kind=logo}
