CX Automation Performance Analyst

Reposted 2 Days Ago
Hiring Remotely in USA
Remote
110K-140K Annually
Mid level
Consumer Web • Fintech • Mobile • Software • Financial Services
Investing built for a better future.
The Role
The CX Automation Performance Analyst manages post-launch AI programs, ensuring ongoing performance and optimization, building dashboards, and maintaining documentation.
Summary Generated by Built In
About Betterment

Betterment is a leading, technology-driven financial services company that offers investing, savings and retirement solutions for retail investors and investment advisors as well as financial wellness solutions, including a 401(k) for small and medium-sized businesses. Our team is passionate about our mission, to empower people to build wealth with confidence and ease.  We’re headquartered in NYC and offer hybrid NY-based positions (four days/ week in-office, with no required office days during the summer and winter holidays).

About the role

The CX Tooling & Innovation team at Betterment is responsible for the systems, AI programs, and automation that power our customer experience. Shipping AI is only half the job — keeping it performing is the other half.

As our CX Automation Performance Analyst, you own the post-launch life of our AI programs. You ensure that what gets launched keeps working, keeps improving, and is well-documented enough that the whole organization can benefit from it.

You'll serve as the primary administrator of net-new AI tooling (VoiceAI, Zendesk AI agents, and others) after launch, owning ongoing configuration, optimization, and performance management. This includes tuning AI agent behavior, updating knowledge sources, adjusting conversation flows, managing prompt configurations, and validating output quality on an ongoing basis.

In your first year, we expect every live AI program to have a performance dashboard with clear KPIs and a regular review cadence, an active optimization backlog producing measurable gains quarter over quarter, complete and current AI documentation being actively used across the organization, and no AI program drifting quietly — degradation is caught early and addressed with a clear plan.

This is a salaried, exempt role that is remote eligible, except for the New York City metro area, San Francisco, Los Angeles, Seattle, Boston, Washington, D.C., & Orange County, CA. Below we've reflected the base salary range we would offer for this position in locations with city or state requirements. For those located elsewhere, the actual compensation offered will be based on candidate experience and geographic location. Actual salaries may vary depending on factors including but not limited to location, experience, and performance. The range listed is just one component of Betterment’s total compensation package for employees. 

Posting range: $110,000 - $140,000

We offer a competitive equity package, health, dental and vision benefits, life and AD&D, short-term and long-term disability insurance, EAP, commuter and parking benefits, FSA/HSA, and 401(k)with employer match as well as a generous PTO policy.

A day in the life
  • Build and maintain dashboards tracking performance across all live AI programs — automation rate, containment, AHT, CSAT, and model quality metrics — using tools like Zendesk Explore, Looker, or similar
  • Identify performance degradation, intent gaps, hallucination, model drift, and guardrail failures across Zendesk AI, chatbots, ticketbots, and automation workflows
  • Own the incident response process for AI quality issues — when performance degrades or a guardrail fails, you triage, escalate, and drive resolution with a clear post-mortem
  • Serve as the primary admin for net-new AI tooling post-launch — including VoiceAI platforms, Zendesk AI agents, and any other tools handed off from the implementation phase
  • Maintain active optimization backlogs for launched programs, ensuring improvements don't stall after initial implementation
  • Drive post-launch iteration in partnership with the Chatbot Strategy Manager and tooling teams, tracking outcomes rigorously
  • Own the AI program documentation library: runbooks, flow documentation, QA procedures, training guides, and internal knowledge base articles
  • Maintain accurate records of AI program behavior, guardrails, and change history to support compliance and audit readiness
  • Partner with the CX AI & Automation Manager during launch phases to establish performance baselines, define QA criteria, and ensure clean handoff documentation
  • Build feedback loops from AI performance data to inform product, engineering, and CX leadership decisions — your insights should shape what gets built next, not just what gets fixed
What we’re looking for
  • Hands-on experience analyzing performance data from AI or automation tools in a support environment
  • Understanding of common AI failure modes — hallucination, model drift, guardrail gaps, and intent misclassification — and the ability to design QA processes that catch them before they reach customers
  • Proficiency with data visualization and reporting tools (e.g., Zendesk Explore, Looker, Tableau, or similar) and comfortable writing queries to validate AI performance data
  • Strong documentation skills — you write clearly, organize well, and build resources people actually use
  • Analytical and detail-oriented: comfortable building dashboards, running QA analysis, and spotting patterns in messy data
  • Experience with Zendesk (or comparable CX platforms) and AI tools such as Zendesk AI, Decagon, or similar
  • Experience in fintech, financial services, or another regulated industry where AI outputs are subject to compliance review and audit
  • A continuous improvement mindset and systems thinker — you see how knowledge structure, prompt design, monitoring, and feedback loops connect, and you're never satisfied with "it launched"
 
What being at Betterment means for you

We change lives

Join a community of innovators working to transform financial outcomes for real people. Your work will make an impact, always laddering up to our mission: making people's lives better.

We set audacious goals

We set them for the company, our customers, and ourselves—and we won’t stop until we reach them. We don’t just show up; we give our all, then celebrate our wins.

We value all perspectives

When we collaborate, we're at our best. We believe diverse perspectives lead to better outcomes and strive to uphold our supportive and inclusive community.

 We invest in you with:

  • A competitive suite of benefits, including: medical, dental, and vision insurance; life and AD&D insurance; STD and LTD benefits, including infertility support and World Professional Association for Transgender Health approved benefits; and generous parental leave. 
  • Flexible paid time off (and encouragement to use it!)
  • Meaningful opportunity for community building through our 7 Employee Resource Groups
  • Empowerment to own and lead change and affect the business
  • Dedicated professional development opportunities
  • Lunch from our in-house chef at our NYC headquarters
What happens next

We’ll take a few weeks to review all applications. If we’d like to spend more time with you, we’ll reach out to arrange next steps, which will include 3-4 sets of meetings with your future colleagues.

In the interview process, we’ll look to learn more about your skills, experiences, capabilities, and motivators. Many of our questions will be aimed at understanding how you might operate here at Betterment. Depending on the role, we may ask you to complete a case study exercise or technical assessments, as we want to collect a robust set of data points to better inform our decisions.

On average, it takes us around 3-5 weeks to make a hiring decision, depending on your availability and sense of urgency. As a best practice, we aim to interview at least 2-3 final round candidates before making a hiring decision. Please note that, as we usually receive an overwhelming number of  applications for open positions, we’re unable to offer individual feedback during the interview process. 

We recognize that interviewing for a new role is a big deal. We appreciate you considering Betterment as the next step in your career, and our Recruiting Team is here to support and advocate for you through the interview process!

Betterment is dedicated to providing accommodations to candidates upon request. If you need accommodations at any point throughout the interview process, please reach out to your recruiter. 

Please note that in any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.

Come join us! 

We’re an equal opportunity employer and comply with all applicable federal, state, and local fair employment practices laws. We strictly prohibit and do not tolerate discrimination against employees, applicants, or any other covered persons because of race, color, religion, creed, national origin or ancestry, ethnicity, sex, gender (including gender nonconformity and status as a transgender or transsexual individual), sexual orientation, marital status, age, physical or mental disability, citizenship, past, current or prospective service in the uniformed services, predisposing genetic characteristic, domestic violence victim status, arrest records, or any other characteristic protected under applicable federal, state or local law.

E-Verify Statement

Betterment participates in E-Verify. We will provide the Social Security Administration, and if necessary, the Department of Homeland Security, with information from each new employee’s Form I-9 to confirm work authorization. Please note that we do not use this information to pre-screen job applicants.
E-Verify Notice
E-Verify Notice (Spanish)
Right to Work Notice
Right to Work Notice (Spanish)

CPRA Language - CA Applicants ONLY 

We collect and store personal information for the purposes of candidate tracking (for this role and future opportunities). The information you provide in the course of completing your application will be kept for up to 24 months. We use tools provided by third-party service providers but do not share candidate information for any purpose other than for recruiting. To access the data that is collected, request deletion or to make updates to your candidate profile, please email [email protected]

Skills Required

  • Hands-on experience analyzing performance data from AI or automation tools in a support environment
  • Understanding of common AI failure modes
  • Proficiency with data visualization and reporting tools
  • Strong documentation skills
  • Analytical and detail-oriented
  • Experience with Zendesk or comparable CX platforms
  • Experience in fintech or regulated industry
  • Continuous improvement mindset and systems thinker

Betterment Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Betterment and has not been reviewed or approved by Betterment.

  • Retirement Support Day-one 401(k) matching and student-loan matching are highlighted, with employees paying zero management fees on company accounts. Feedback suggests these financial-wellness features are unusually robust for a mid-size fintech.
  • Leave & Time Off Breadth Flexible PTO and a four-week sabbatical at year six are positioned as meaningful time-away benefits. Feedback suggests these provisions contribute to positive work-life balance perceptions.
  • Equity Value & Accessibility Equity grants for all employees (new-hire, performance, and refreshers) are emphasized as part of total compensation. Feedback suggests ownership opportunities add meaningful value alongside salary.

Betterment Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
400 Employees
Year Founded: 2010

What We Do

Betterment is the largest independent digital investment advisor in the U.S., offering investing and retirement solutions alongside their everyday services for spending and saving. Using cutting-edge technology, expert advice, automated money management tools, and tax-smart strategies, they empower hundreds of thousands of customers to manage their money—for today, tomorrow, and someday.

Why Work With Us

At Betterment, we revolutionize the way people manage their money through innovative technology and personalized guidance. With a culture of empowerment, endless growth opportunities, and focus on a well-balanced life, working at Betterment means being part of our mission of making people’s lives better.

Gallery

Gallery

Similar Jobs

Wipfli Logo Wipfli

Senior Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
Reston, VA, USA
3000 Employees

Wipfli Logo Wipfli

Senior Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
Chicago, IL, USA
3000 Employees
88K-118K Annually

Mondelēz International Logo Mondelēz International

Digital Supply Chain Engineering Director

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
3 Locations
90000 Employees
143K-235K Annually

Granica Logo Granica

Software Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office or Remote
Mountain View, California, USA
45 Employees

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account