Research Engineer, Post-Training

Reposted One Month Ago
San Francisco, CA, USA
In-Office
170K-280K Annually
Mid level
Artificial Intelligence • Machine Learning • Software • Analytics
An AI-powered understanding engine for software and engineering teams.
The Role
Build and improve ML systems powering core AI capabilities: create and maintain evaluation datasets, design experiments, train and fine-tune models (including RL approaches), analyze results to drive product decisions, participate in research, and partner with product and backend teams to integrate models into production.
Summary Generated by Built In
About Macroscope

Macroscope is building the infrastructure for the next generation of software development, where engineers direct fleets of agents, every change is automatically reviewed and verified, and organizations have a clear understanding of how their products and codebases are evolving.

Our mission is to give engineers more leverage and leaders more clarity, so teams can build better software, faster.

Macroscope is founded by former entrepreneurs who have started and sold multiple companies, and operated as product/engineering executives at public tech companies. We're fortunate to be supported by the best VC firms and angels in the business, including Lightspeed Venture Partners, Thrive Capital, Google Ventures, and Adverb.

About the role

We're looking for an Research Engineer to improve the models and ML systems behind Macroscope's core AI capabilities. You'll work closely with our founders and engineering team to build evaluation datasets, run experiments, train and fine-tune models, and determine what meaningfully improves model performance.

You'll have ownership across the ML lifecycle, including model evaluation, reinforcement learning, and bringing new approaches into production. You'll also explore emerging research and training techniques that can push what's possible with AI for software engineering.

Our technology stack: TypeScript/React (front end), Golang (backend), Temporal, Google Cloud (GCP), Postgres, Terraform, and custom-built AST "code walkers" in Golang, TypeScript, Swift, Python, and Rust.

Qualifications
  • 3+ years of experience in applied machine learning, AI, or related engineering roles.

  • Experience building, training, fine-tuning, or evaluating modern ML models in production or research environments.

  • Experience with reinforcement learning for LLMs, including RLHF, RLAIF, GRPO, PPO, DPO, or similar techniques.

  • Strong experience with dataset creation, curation, benchmarks, labeling strategies, and evaluation methodologies.

  • Experience designing rigorous experiments and using results to improve model performance.

  • Familiarity with LLMs, reasoning models, and the evolving open-source model ecosystem.

  • Strong software engineering skills and experience building reliable ML pipelines and tooling.

  • Comfortable working in a fast-paced, high-agency startup environment.

  • Golang experience is a plus, but not required.

  • Bonus: Experience with distributed training, preference optimization, synthetic data generation, evaluation frameworks, GCP, Temporal, or internal ML tooling.

The base pay for the Applied ML Engineer position ranges from $180,000 to $280,000 per year. Pay is based on several factors and may vary depending on job-related knowledge, skills, and experience.

About you
  • You are extremely high agency. We are a small startup and we intend to keep an extremely flat organizational structure for as long as possible. Instead of relying on people managers, product managers and heavy processes, we rely on exceptionally talented individuals with high agency to be self-motivated towards contributing to our mission.

  • You want to work at an early stage startup. The default state of any startup is failure. The only way to overcome the daunting odds of making a startup venture successful is for a densely packed group of insanely hard working and talented people to work together to build something useful to and loved by customers. If you're not willing to work extremely hard on something high risk, this startup isn't for you.

  • You act like an owner. You put immense care and craft into what you build because you take responsibility for all parts of the product. You don't walk past broken windows.

  • You care about what we're building. Life's too short to work on something you're not passionate about. We are a small group of ambitious people who want to build something insanely great that we want to use, and that we think every company will want to use. If our mission and product don't resonate with you, we understand and would encourage you to find something that does.

Skills Required

  • 3+ years of experience in applied machine learning, AI, or related engineering roles
  • Experience building, training, fine-tuning, or evaluating modern ML models in production or research environments
  • Experience with reinforcement learning or reinforcement learning for LLMs (RLHF, RLAIF, GRPO, PPO, DPO, or similar)
  • Strong skills in dataset creation, curation, and evaluation, including designing benchmarks, labeling strategies, and evaluation methodologies
  • Experience designing and running rigorous experiments, analyzing results, and using data to drive model improvements
  • Familiarity with LLMs, reasoning models, and the open-source model ecosystem
  • Strong software engineering skills and experience building reliable ML pipelines and tooling
  • Comfortable working in a fast-paced, high-agency startup environment
  • Experience in Golang
  • Experience with large-scale distributed training
  • Experience with preference optimization or synthetic data generation
  • Experience with evaluation frameworks, GCP infrastructure, Temporal, or building internal ML tooling

Macroscope Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Macroscope and has not been reviewed or approved by Macroscope.

  • Fair & Transparent Compensation — Job postings display salary ranges for several roles, giving clear upfront expectations on base pay. Public listings also indicate compensation bands by role and location, enabling candidates to benchmark during the process.
  • Equity Value & Accessibility — Job ads consistently mention equity alongside cash, indicating equity is a standard part of offers. Several postings highlight equity in role descriptions, signaling accessible ownership opportunities at this stage.

Macroscope Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
26 Employees
Year Founded: 2023

What We Do

Macroscope is an AI-powered developer platform that helps engineering teams understand and manage complex codebases through intelligent code analysis. The platform summarizes engineering activity, detects bugs, and answers natural-language questions about code to improve productivity.

Why Work With Us

We are a small startup and we intend to keep an extremely flat organizational structure for as long as possible. Instead of relying on people managers, product managers and heavy processes, we rely on exceptionally talented individuals with high agency to be self-motivated towards contributing to our mission.

Gallery

Gallery

Similar Jobs

CHAI AI Logo CHAI AI

Senior Research Engineer, Post-Training

Artificial Intelligence • Software • Generative AI
In-Office
Palo Alto, CA, United States
20 Employees
609K-900K Annually
In-Office
San Francisco, CA, USA
2217 Employees
250K-500K Annually

Lightning AI Logo Lightning AI

Senior Research Engineer, LLM Training & Post-Training

Artificial Intelligence • Machine Learning • Software
Remote or Hybrid
3 Locations
50 Employees
165K-310K Annually

Thinking Machines Lab Logo Thinking Machines Lab

Software Engineer

Artificial Intelligence • Information Technology
Hybrid
San Francisco, CA, USA
91 Employees
350K-475K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account