Software Engineer - Evals

Posted 3 Days Ago
Palo Alto, CA, USA
In-Office
175K-275K Annually
Mid level
Information Technology
The Role
Build, own, and improve the evals platform that measures model capabilities and behaviors. Design datasets and grading schemes, manage execution infrastructure, diagnose failures, and deliver robust tools engineers use to clean data, provide experiment feedback, and track model growth.
Summary Generated by Built In

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

You will own and elevate our mission-critical research platform that directly accelerates xAI’s frontier work.

The evals team creates and executes instruments for measuring model capabilities and behaviors. These instruments are used to clean datasets, provide feedback for experiments, and track growth throughout training. The evals team also diagnoses why agents fail and how to make improvements both short and long term. We manage the execution infrastructure, design data sets and grading schemes.

You will design, build, and ship delightful and bulletproof systems that engineers love to use every day. This role values a strong attention to details, first principles reasoning, and great taste.  

We are open to all levels from new grads to senior engineers.

Requirements

  • Software engineering proficiency and 3+ years of experience actively writing code.
  • A track record of shipping high quality projects and a strong sense of urgency.
  • Exceptional product taste -  you have a sharp sense for what “good” looks like in outputs, and you can translate fuzzy notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.
  • Strong attention to detail.

Bonus Points

  • Previously founded a startup or joined a fast-growing early-stage startup.
  • Familiarity with AI/ML workflows, annotation tools, or evals.
  • Experience creating and maintaining component libraries, design systems, or internal tools.

COMPENSATION AND BENEFITS:

$175,000 - $275,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Skills Required

  • Software engineering proficiency with 3+ years of actively writing code
  • Track record of shipping high-quality projects and strong sense of urgency
  • Exceptional product taste; translate quality, helpfulness, truthfulness, and safety into measurable criteria
  • Strong attention to detail
  • Strong communication skills
  • Hands-on mindset; contribute directly to company mission
  • Previously founded or joined a fast-growing early-stage startup
  • Familiarity with AI/ML workflows, annotation tools, or evals
  • Experience creating and maintaining component libraries, design systems, or internal tools
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
96 Employees

What We Do

Understand the Universe

Similar Jobs

Sentry Logo Sentry

Senior Software Engineer

Cloud • Information Technology • Software • Analytics • Business Intelligence
Hybrid
San Francisco, CA, USA
241 Employees
240K-280K Annually

OpenAI Logo OpenAI

Software Engineer

Artificial Intelligence • Machine Learning • Generative AI
In-Office
2 Locations
4500 Employees
230K-385K Annually

LangChain Logo LangChain

Software Engineer

Information Technology • Software • Database
In-Office
3 Locations
123 Employees
155K-195K Annually

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account