Applied AI Engineer, Evals

Posted One Month Ago
San Francisco, CA, USA
In-Office
Entry level
Artificial Intelligence • Software • Generative AI
The Role
Design and implement evaluations for AI agents across voice, vision, and browser use. Build benchmarks, simulations, and scoring systems for customer-specific scenarios, then use evaluation findings to improve agent behavior, context, and underlying models.
Summary Generated by Built In
About Sable

Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.

 
The role

You translate what makes a good performance into clear, defensible signals, and use those signals to improve Aidan. Role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.

 
What you'll do
  • Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models

  • Build and maintain our internal benchmarks and simulations

  • Work on systems to score customer-specific scenarios and identify gaps in current capabilities.

Who you are
  • Engineer with statistics and/or applied machine learning experience

  • Comfortable in a production codebase

  • Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.

Skills Required

  • Experience with statistics and/or applied machine learning
  • Comfort working in a production codebase
  • Prior experience with evaluations, voice, realtime systems, or browser/computer-use agents
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
56 Employees
Year Founded: 2019

What We Do

Sable is an AI company based in San Francisco that builds multimodal digital-human enterprise workers for the world's largest organizations. By combining voice, video, and browser navigation with deep business context, Sable is redefining the future of work, specifically focusing on products that will transform Go-To-Market (GTM) strategies.

Similar Jobs

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Claims Adjuster I, Workers' Compensation

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Hybrid
12 Locations
40000 Employees
57K-101K Annually

Federal Reserve Bank of Boston Logo Federal Reserve Bank of Boston

Senior Vice President, FRS District IT & Corporate Services Business Information Security Officer (BISO)

Fintech • Information Technology • Payments • Sharing Economy • Financial Services • Cryptocurrency
In-Office
12 Locations
1200 Employees
276K-380K Annually

Federal Reserve Bank of Boston Logo Federal Reserve Bank of Boston

Senior Vice President, Central Bank Services Business Information Security Officer (BISO)

Fintech • Information Technology • Payments • Sharing Economy • Financial Services • Cryptocurrency
In-Office
12 Locations
1200 Employees
276K-380K Annually

Federal Reserve Bank of Boston Logo Federal Reserve Bank of Boston

Senior Vice President, FRS System IT Ops and Policy Business Information Security Officer (BISO)

Fintech • Information Technology • Payments • Sharing Economy • Financial Services • Cryptocurrency
In-Office
12 Locations
1200 Employees
276K-380K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account