Research Scientist, Reinforcement Learning

Posted 10 Hours Ago
Be an Early Applicant
Palo Alto, CA, USA
In-Office
Entry level
Artificial Intelligence • Security • Software
The Role
Conduct research on reinforcement learning post-training for reasoning models. Develop RLVR methods using Lean 4’s verified rewards, create novel RL algorithms and test-time compute optimizations, advance autoformalization, curate training data, and build evaluations for formal reasoning. The role owns the full research loop from rollout sampling and reward design through model updates and evaluation, with emphasis on autonomous, state-of-the-art research in long-horizon logical tasks.
Summary Generated by Built In
Company

Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved.

Pramaana's architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.

The role

We're training foundation models to natively interact with symbolic world models. As an RL Post-Training Researcher, you'll take foundation models and scale their reasoning capabilities: applying RLVR to new domains using verified rewards from the Lean kernel, pushing the frontier of autoformalization and proving, and innovating on RL algorithms, data, and evals. Your work will also define how our models leverage test-time compute to solve long-horizon logical tasks.

What you'll actually work on
  • Scale RLVR to new, real-world domains using the Lean kernel as a deterministic reward signal.

  • Design and implement novel RL algorithms and test-time compute optimizations tailored for formal environments and proof search.

  • Push the frontier of autoformalization, training models to map highly technical natural language into strict formal specifications.

  • Curate data and build evals that tightly correlate with verifiable downstream reasoning capabilities.

  • Own the whole loop: rollout sampling, reward design, the update, the eval.

You Will Thrive in This Role If You Have
  • Deep, hands-on research experience in reinforcement learning applied to reasoning models at scale.

  • Experience working with RLVR, test-time RL, or exact deterministic reward signals.

  • Strong algorithmic and systems intuition — comfortable writing custom RL loops, managing data pipelines, and building robust evals from scratch.

  • High autonomy: the ability to take a fuzzy problem area and independently drive it to state-of-the-art results without day-to-day direction.

Especially Strong Candidates May Also Have
  • A background in formal verification (Lean, Coq, or Isabelle)

  • A strong publication record in top-tier venues (NeurIPS, ICML, ICLR).

Skills Required

  • Deep, hands-on research experience in reinforcement learning applied to reasoning models at scale
  • Experience with RLVR, test-time reinforcement learning, or exact deterministic reward signals
  • Strong algorithmic and systems intuition
  • Experience writing custom reinforcement learning loops
  • Experience managing data pipelines
  • Experience building robust evaluations from scratch
  • Ability to independently drive ambiguous research problems to state-of-the-art results
  • Background in formal verification, including Lean, Coq, or Isabelle
  • Strong publication record in top-tier venues such as NeurIPS, ICML, or ICLR
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
33 Employees
Year Founded: 2025

What We Do

Pramaana Labs builds the verification layer for AI, translating complex human knowledge—including tax codes, clinical guidelines, legal rules, and safety constraints—into machine-checkable logic. Its domain-specific systems use provers and solvers to search solution spaces and return proof artifacts, counterexamples, and traceable explanations for expert review. The aim is to make AI answers verifiable, challengeable, and defensible, supporting more accountable AI deployment across high-stakes applications.

Similar Jobs

Prime Intellect Logo Prime Intellect

Scientist

Artificial Intelligence • Software
In-Office or Remote
San Francisco, CA, USA
16 Employees
150K-350K Annually

Epsilon Health Logo Epsilon Health

Scientist

Healthtech • Software
In-Office
San Francisco, CA, USA
6 Employees

Luma AI Logo Luma AI

Scientist

Artificial Intelligence • Software
Remote or Hybrid
10 Locations
246 Employees
188K-395K Annually
In-Office
Sunnyvale, CA, USA
3411 Employees
126K-423K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account