Software Engineer - Developer Experience

Reposted 4 Days Ago
San Francisco, CA
In-Office
Mid level
Artificial Intelligence • Information Technology • Software • Cybersecurity
The Role
This role involves managing the technical lifecycle of data pipelines, from prototyping to production, with a focus on developer experience and quality governance.
Summary Generated by Built In

We’re building a gamified developer platform where tens of thousands of engineers create high‑fidelity datasets that push LLM frontiers. This role owns the technical lifecycle of data pipelines—from defining new data formats with partner labs to shipping the tooling, environments, docs, and QA that make those formats real at scale.

What You’ll Do
  • Own projects end-to-end, from initial prototyping to ongoing maintenance, bug fixing, and iteration based on feedback.

  • Own developer experience pipelines end‑to‑end: Prototype tooling for collecting new data formats → productionize workflow → iterate from developer experience

  • Champion DX: Create clear, concise guidelines and documentation to empower our data contributors and ensure high-quality inputs for your projects.

  • Quality & governance: Develop and manage the quality standards for your projects, which includes training and aligning content reviewers to ensure data consistency and accuracy. Implement automated checks, eval harnesses, reviewer workflows, and data quality bars; be hands on and in the weeds to align with reviewers on standards.

  • Maintain & iterate: Monitor, debug, and continuously improve reliability, latency, and contributor success rates.

What You’ll Do Sometimes
  • Define Frontier data formats: Co‑author specs/RFCs with frontier lab researchers; design schemas, metadata, and versioning for new task/trajectory formats.

  • Build developer tooling & environments: Ship tooling, sandboxes, CLIs/SDKs, and capture/instrumentation to make contribution flows fast and safe.

You’ll Succeed Here If You Have
  • Excellent written communication skills, with a proven ability to explain complex concepts to a less technical audience.

  • An organized and process-oriented mindset – you enjoy bringing structure to ambiguous problems and are meticulous about quality.

  • Foundational full-stack skills, with experience in React and at least one modern backend language (e.g., Python, Node.js, Go).

  • Strong technical judgment and a pragmatic mindset – you know how to balance speed with quality, recognizing the need for a scrappy solution versus when to invest in a robust architecture.

  • A deep resourcefulness with AI – you are highly adept at prompt engineering and using AI tools to find the fastest path to a solution.

Characteristics we’re looking for
  • Curiosity, pride in your work, desire to push the frontiers

Nice to Have
  • Experience designing or running evaluations for LLM outputs to measure and track quality, accuracy, or other performance metrics.

  • Familiarity with building tools for other developers, such as CLIs, SDKs, or internal dashboards.

  • Experience with cloud infrastructure (AWS), Docker, and CI/CD pipelines

Top Skills

AWS
Ci/Cd
Docker
Go
Node.js
Python
React
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2024

What We Do

Providing code data vetted by the best engineers, so you can build the most capable models

Similar Jobs

In-Office or Remote
3 Locations
800 Employees

Block Logo Block

Senior Software Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
185K-327K Annually

Square Logo Square

Account Executive

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
130K-234K Annually

Square Logo Square

Product Manager

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
139K-245K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account