Product Engineer - AI Data

Reposted 9 Hours Ago
Palo Alto, CA
In-Office
180K-440K
Senior level
Information Technology
The Role
Design and implement evaluation pipelines for AI models, focusing on user feedback integration and performance optimization in consumer products.
Summary Generated by Built In
About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Role

You will design and implement evaluation pipelines that enable xAI’s models to self-improve through end-user interactions, building features and data flows that capture human feedback to drive continuous optimization of user value, engagement, and key metrics in consumer products reaching millions of users.

You’ll work with us on:
  • Building RLHF tooling to gather and incorporate end-user preferences and feedback, enabling models to iteratively self-improve based on real-world usage
  • Developing data pipelines and AI evaluation frameworks to track model performance, safety, user satisfaction, and metrics like retention and engagement from an end-user lens
  • Work in product and work with our model training teams to optimize and productionize AI powered features.
You’ll flourish in this role if you:
  • Have a strong grasp of scaling AI products from prototype to global deployment
  • Are skilled in developing robust AI evaluation methodologies, including benchmarks and metrics for alignment and user-centric improvement
  • Have hands-on experience with RLHF or similar preference-based learning systems
  • Thrive in ambiguous environments, iterating quickly based on feedback loops and data-driven insights
  • Are passionate about AI creating transformative and user-centric technologies
  • Consider yourself a high-agency builder who bridges research and product realities
Ideal Experience
  • Proven track record in RLHF implementation or AI alignment projects.
  • Experience building data pipelines for metric optimization and model self-improvement in fast-paced environments.
  • Familiarity with evaluation tools and frameworks (e.g., custom benchmarks, A/B testing for AI, user analytics).
  • Strong portfolio or contributions demonstrating evaluation work and feature development for user impact.
Interview Process

After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15 minute interview (“phone interview”) during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process:

  1. Technical deep-dive: Discussing your evaluation and pipeline experience
  2. A take-home challenge on building an AI eval or feedback prototype
  3. Meet and greet with the wider team.

Our goal is to finish the main process within one week.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer.

California Consumer Privacy Act (CCPA) Notice

Top Skills

A/B Testing
AI
Data Pipelines
Evaluation Methodologies
Ml
Rlhf
User Analytics
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
96 Employees

What We Do

Understand the Universe

Similar Jobs

Labelbox Logo Labelbox

Product Engineer

Artificial Intelligence • Information Technology • Machine Learning
In-Office
7 Locations
160K-260K Annually

Cox Enterprises Logo Cox Enterprises

Lead Data Scientist

Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Hybrid
Irvine, CA, USA
120K-199K Annually

Cox Enterprises Logo Cox Enterprises

Client Development Executive (Cox Business)

Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Hybrid
Irvine, CA, USA
63K-94K Annually

Anduril Logo Anduril

Senior Electrical Engineer

Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
In-Office
Costa Mesa, CA, USA
120K-213K Annually

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
17 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account