AI Evaluations Program Manager

Posted 8 Days Ago
Easy Apply
Hiring Remotely in United States
Remote or Hybrid
Senior level
Fintech • Mobile • Software • Financial Services
SoFi’s mission is to help people reach financial independence to realize their ambitions.
The Role
Manage the evaluation of AI-generated chat outputs to ensure accuracy and compliance, while leading continuous improvement in collaboration with various teams.
Summary Generated by Built In

Employee Applicant Privacy Notice

Who we are:

Shape a brighter financial future with us.

Together with our members, we’re changing the way people think about and interact with personal finance.

We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world.

The role:

We are seeking an AI Evaluations Program Manager to own the end-to-end process for evaluating AI chat outputs in a financial services context. This role is critical to ensuring our AI delivers guidance and education that is accurate, compliant, consistent, and genuinely helpful to members who want to Get Their Money Right. 

You’ll be responsible for managing the daily evaluation workflows for AI-generated chat responses, with particular attention to financial accuracy, regulatory risk, and user helpfulness. You’ll also own the continuous improvement loop, translating evaluation insights into measurable improvements through partnership with our Legal, Compliance, Engineering, Product, and Design (EPD) teams. 

As the program manager, you’ll sit at the intersection of product, AI, operations, risk, and financial expertise, helping us achieve our mission to empower members to reach financial independence.

What you’ll do:

  • Own the AI Evaluation Program on SoFi’s AI powered financial coach, designing processes related to daily workflows, schedules for grading and reporting. 

  • Work alongside our technology team to integrate feedback and test improvements of AI guardrails and overall knowledge base. 

  • Establish and lead the continuous improvement loop to ensure all stakeholders are informed of performance, improvements, trends, issues and other metrics.  

  • Partner with Product, Legal & Compliance to maintain the AI knowledge base as well as any data retention and documentation processes. 

What you’ll need:

  • 8+ years of professional experience working in program management, operations, quality, risk, or evaluation roles within a financial services organization. 

  • Familiarity with AI/LLM technologies and their application in providing personalized guidance.

  • Experience building and managing structured processes in complex or regulated environments. 

  • Excellent analytical skills and comfort working with both qualitative and quantitative data. 

  • Strong Stakeholder Management skills, with the ability to drive alignment across technical, financial, and regulatory partners. 

  • Familiarly with financial products such as investments, retirement accounts, loans and banking. 

Nice to have:

  • Credentials: CFP® or other professional financial designation is a ✓++

  • Licenses: FINRA Series 65 or interest in obtaining 

  • Prior experience in financial technology (fintech), Financial Advisory or Wealth Management. 

  • Experience directly working with technical teams

Compensation and Benefits
The base pay range for this role is listed below. Final base pay offer will be determined based on individual factors such as the candidate’s experience, skills, and location. 
 
To view all of our comprehensive and competitive benefits, visit our Benefits at SoFi page!
SoFi provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth and related medical conditions, breastfeeding, and conditions related to breastfeeding), gender, gender identity, gender expression, national origin, ancestry, age (40 or over), physical or medical disability, medical condition, marital status, registered domestic partner status, sexual orientation, genetic information, military and/or veteran status, or any other basis prohibited by applicable state or federal law.The Company hires the best qualified candidate for the job, without regard to protected characteristics.Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.New York applicants: Notice of Employee RightsSoFi is committed to an inclusive culture. As part of this commitment, SoFi offers reasonable accommodations to candidates with physical or mental disabilities. If you need accommodations to participate in the job application or interview process, please let your recruiter know or email [email protected].Due to insurance coverage issues, we are unable to accommodate remote work from Hawaii or Alaska at this time.
Internal Employees
If you are a current employee, do not apply here - please navigate to our Internal Job Board in Greenhouse to apply to our open roles.

Top Skills

AI
Compliance Processes
Financial Services Technology
Llm

What the Team is Saying

Kari
Niyati
Mike
Suban
Caroline
Mona
Donald
Kari
Yelena
Thomas
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
4,500 Employees
Year Founded: 2011

What We Do

SoFi wasn’t built to be a bank. Or a technology company. We were built for one mission: help people achieve financial independence so they can realize their ambitions.

Redefining an entire industry isn’t easy work—and it’s not for the faint of heart. It takes a certain kind of team. People with diverse perspectives and expertise, united by a common sense of purpose. People willing to challenge assumptions but always do the right thing. People proving that innovation and responsibility don’t have to compete, but can come together to create something truly unconventional in the world.

For the last eight years, we’ve been charting this new path forward. We call it The SoFi Way.
At SoFi, we don’t just talk about culture: we live it. The SoFi Way is how we show up every day, how we make decisions, and how we build for our members, clients, and each other.

Why Work With Us

Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation Fintech company using innovative, mobile-first technology to help our members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

SoFi Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

For the majority of our workforce who work on a hybrid schedule, the in-office requirement is a handful of days per month!

Typical time on-site: Flexible
Company Office Image
HQSan Francisco, CA
Company Office Image
Cottonwood Heights, UT
Company Office Image
Frisco, TX
Company Office Image
Helena, MT
Company Office Image
Jacksonville, FL
Company Office Image
New York, NY
Company Office Image
Seattle, WA
Learn more

Similar Jobs

SoFi Logo SoFi

AML Compliance Specialist - Client Intelligence Unit

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
United States
4500 Employees

SoFi Logo SoFi

Senior Data Engineer

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
Cottonwood Heights, UT, USA
4500 Employees

SoFi Logo SoFi

Senior Operations and Supplier Testing Analyst

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
Cottonwood Heights, UT, USA
4500 Employees

SoFi Logo SoFi

Executive Assistant

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
United States
4500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account