Software Engineer, Pretraining Data

Posted 7 Days Ago
Palo Alto, CA, USA
In-Office
160K-250K Annually
Mid level
Artificial Intelligence • Generative AI
The Role
Build large-scale data platforms, crawling systems, and pipelines that transform web, code, multimodal, and acquired data into training-ready datasets for frontier models. Responsibilities include improving data quality, lineage, observability, crawling coverage, parsing, scheduling, and pipeline reliability. The role also involves training high-throughput data classification and filtering models, running data-mixture experiments, and partnering with research and acquisition teams to improve model training outcomes.
Summary Generated by Built In

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

SOFTWARE ENGINEER, PRETRAINING DATA

We're looking for Software Engineers to build the data systems behind our frontier models' initial training. You'll work on large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into the datasets our models train on, and making iteration with researchers fast and reliable.

RESPONSIBILITIES:

Data Platform:

  • Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs

  • Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale

  • Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run

  • Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability

Data Quality:

  • Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability. If something breaks or drifts, your systems will tell us before the training run does

  • Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput. These models have to be both accurate and fast enough to sit in the critical path without becoming the bottleneck

  • Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth that turn "this dataset feels good" into hard evidence the training team can trust

  • Partner tightly with Data Acquisition to hunt down missing or low-quality sources, and with the training teams to close the loop on what actually moves loss and downstream evals

  • Treat data quality as a systems problem and a research problem. You will write performance-critical code one week and design careful experiments the next

Crawling:

  • Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training

  • Improve URL seeding, scoring, and fair host scheduling so crawl capacity lands on the hosts and pages that matter most for model quality

  • Raise crawl success and parsing quality, defeating antibot failures, improving extractors, and capturing content we previously could not get cleanly

  • Debug and harden complex crawl infrastructure end-to-end for availability, recovery, and ingestion lag, and automate delivery of crawl datasets into the data pipeline

  • Work independently (and alongside AI agents) and partner with Data Quality and Data Platform so new coverage shows up as better tokens in training runs

BASIC QUALIFICATIONS:

  • Minimum of 3 years of software engineering experience

  • Software engineering experience building distributed systems and/or large-scale data infrastructure

PREFERRED SKILLS AND EXPERIENCE:

  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience

  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents

  • Strong intuitions about large-scale distributed systems

  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

ADDITIONAL REQUIREMENTS:

  • Onsite role: must be able to work in person at the Palo Alto office

COMPENSATION AND BENEFITS:

The annual compensation range for this role is listed below.

Annual Salary:

$160,000 - $250,000 USD

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Skills Required

  • Minimum of 3 years of software engineering experience
  • Software engineering experience building distributed systems and/or large-scale data infrastructure
  • Ability to work onsite in person at the Palo Alto office
  • Experience moving unusually fast or achieving staff-level ownership within a few years
  • Ability to architect and ship end-to-end with high ownership
  • Ability to debug complex systems independently
  • Ability to work alongside AI agents
  • Strong intuition about large-scale distributed systems
  • Interest in how pretraining data shapes model quality
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Lincoln
300 Employees
Year Founded: 2022

What We Do

We'd like to automate coding. To advance that mission, we're building Cursor. Our work includes training the world’s most widely used coding models, creating infrastructure that supports billions of requests per day, and building better ways for humans and AIs to work together.

Similar Jobs

Cursor Logo Cursor

Senior Software Engineer

Artificial Intelligence • Generative AI
In-Office
Palo Alto, CA, USA
300 Employees
220K-357K Annually

Hilton Logo Hilton

Director, Platform Activation

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
4 Locations
500000 Employees
130K-175K Annually

Hilton Logo Hilton

Banquet Set Up Attendant - Hilton San Francisco Union Square

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
San Francisco, CA, USA
500000 Employees

BAE Systems, Inc. Logo BAE Systems, Inc.

Shipyard Intern- Winter 2027

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Hybrid
San Diego, CA, USA
40000 Employees
38K-51K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account