Senior Software Engineer - AI Tooling & Automation

Reposted Yesterday
Be an Early Applicant
San Francisco, CA, USA
In-Office
149K-246K Annually
Senior level
Cloud • Software
If you’re ready to build your future — and the future of technology — then you’re in the right place.
The Role
Senior software quality engineer focused on designing, building, and maintaining AI-first testing frameworks and automation for sales forecasting and agentic capabilities. Validate LLM integrations, perform white-box testing, evaluate model quality and safety, fix flakiness, and collaborate with product, engineering, and data science teams to ensure high-quality CI/CD delivery of AI-driven enterprise features.
Summary Generated by Built In

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Software Engineering

Job Details

About Salesforce

Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

Software Quality Senior Member of Technical Staff (SMTS)

Job Category: Software Engineering

About Salesforce
We’re Salesforce, the Customer Company, inspiring the future of business with AI+Data+CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Job Details

We are infusing AI into every aspect of our software engineering. While AI is accelerating how we build, the depth of intelligence and reliability of our systems is what sets us apart at enterprise scale. We are looking for an enthusiastic Senior Engineer who takes an AI-first approach to help build and evolve our Sales Agent and Forecasting capabilities within the Revenue Action Orchestration (RAO) organization.

This individual will work on cutting-edge AI-powered products that tackle one of the most critical problems for enterprise sales teams — accurate revenue forecasting and intelligent sales automation. You will play a key role in designing, implementing, and maintaining robust, scalable systems that bring AI-driven insights directly into the hands of sales teams worldwide.

As a member of the RAO team, you will collaborate with cross-functional partners across product development, data science, and AI teams to deliver Salesforce's AI-driven Sales Agent and Forecasting solutions to the highest quality standards for enterprise applications. The ideal candidate has a strong engineering foundation, a passion for AI/ML-powered products, and the drive to be a multiplier — helping the team accelerate velocity and accuracy through modern AI tooling and practices. Prior experience on a Data Science, ML Science, or ML Engineering team is a plus.

Key Responsibilities
Drive Innovation & Adoption: Design, build, and maintain scalable, AI-first testing frameworks and automation suites to validate complex RAO workflows and agentic capabilities.
Execute Quality Strategies: Translate high-level quality strategies into actionable automation plans, focusing heavily on validating LLM integrations, prompt accuracy, and deterministic system behaviors.
Hands-on Code Quality & White-Boxing: Dig deep into the application code to understand system architecture, identify quality gaps, perform white-box testing, and actively contribute to fixing code and test flakiness.
Human-in-the-Loop & Model Evaluation: Implement and support evaluation processes for subjective quality dimensions of our AI features, including response relevance, user safety, and contextual accuracy.
Cross-Functional Collaboration: Partner closely with developers, product managers, and engineers within the RAO ecosystem to ensure quality is integrated early and continuously throughout the agile delivery lifecycle.
Required Skills and Qualifications
Strong Java Skills: Strong technical fundamentals of Java, particularly in data structures and algorithms.
AI/LLM Validation Mindset: Hands-on experience evaluating Large Language Models (LLMs) for quality response, including familiarity with GPT-like models and AI evaluation frameworks is a big plus.
Agile Delivery at Pace: Proven track record of delivering automation solutions in a fast-paced CI/CD environment, supporting rapid deployment schedules without compromising quality.
Collaboration & Communication: Excellent communication skills, with the ability to work cross-functionally with product managers, engineers, AI/ML engineers, and data scientists.
Problem-Solving & Analytical Skills: Strong analytical and problem-solving abilities with a focus on identifying quality gaps and driving improvement.
Preferred Qualifications
A software engineer with a strong coding background and understanding of delivering software at pace in Agentic PDLC.
Strong experience with white-box testing and fixing code is a huge plus.
Experience working with public cloud infrastructure (AWS/Azure/GCP) and/or foundational knowledge of the Salesforce platform (Salesforce Certifications are a plus).
Prior experience testing autonomous agents, conversational UIs, or generative AI workflows.

Unleash Your Potential

When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world.

Accommodations

If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form.

Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our Candidate Privacy Statement for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.

In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.

At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $148,500 - $223,900 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $178,900 - $246,000 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.

Skills Required

  • Strong Java skills, including data structures and algorithms
  • Proven track record delivering automation solutions in fast-paced CI/CD environments
  • Excellent cross-functional communication and collaboration skills
  • Strong analytical and problem-solving abilities
  • Hands-on experience evaluating Large Language Models (LLMs) and GPT-like models
  • Prior experience on Data Science, ML Science, or ML Engineering teams
  • Experience with white-box testing and fixing code/test flakiness
  • Experience with public cloud infrastructure (AWS, Azure, or GCP) and/or Salesforce platform
  • Prior experience testing autonomous agents, conversational UIs, or generative AI workflows

Salesforce Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Salesforce and has not been reviewed or approved by Salesforce.

  • Fair & Transparent Compensation Pay is positioned as above-market in the U.S., with multiple peer-reported benchmarks converging around a similar median total compensation figure. Compensation is also framed as broadly viewed as fair in aggregate, even while acknowledging variation by role and group.
  • Parental & Family Support Parental leave is described as notably generous for U.S. caregivers, with additional supports like gradual return-to-work and doula reimbursement. Family-building programs are also emphasized through fertility/adoption/surrogacy support with sizeable reimbursement limits.
  • Wellbeing & Lifestyle Benefits Mental-health and coaching offerings are highlighted as accessible supports alongside financial-wellbeing tools. Volunteer Time Off and donation matching are presented as distinctive lifestyle-aligned benefits that add value beyond cash compensation.

Salesforce Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
72,000 Employees

What We Do

Salesforce is the #1 AI CRM, where Humans with agents drive customer success together. Through Agentforce, our groundbreaking suite of customizable agents and tools, Salesforce brings autonomous AI agents, unified data from any source, and best-in-class Customer 360 apps together on one integrated platform to help companies connect with customers in a whole new way. Salesforce is democratizing AI agents for businesses of every size and industry so every company can embrace a workforce without limits. Our low code, open, and secure platform helps companies build and customize Salesforce fast so they can safely scale AI-powered work to every customer and employee experience and transform their business. Salesforce is proud to be the market leader, but we’re even more proud to lead in philanthropy, innovation and culture. Guided by core values of trust, customer success, innovation, equality, and sustainability, Salesforce is more than a business — we’re a platform for change.

Why Work With Us

There’s no typical day in the life of a Salesforce employee. You could be transforming our next AI innovation — or transforming your community. Closing deals — or closing your laptop for a day of Volunteer Time Off. Driving change for our customers — or driving change within one of our high-performing teams.

Gallery

Gallery

Similar Jobs

In-Office
2 Locations
72000 Employees
149K-246K Annually

Ericsson Logo Ericsson

Administrative Assistant

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Hybrid
Santa Clara, CA, USA
88000 Employees
96K-125K Annually

AMP Logo AMP

Director, Commercial Origination & Business Development

Artificial Intelligence • Computer Vision • Greentech • Machine Learning • Robotics • Industrial • Automation
Easy Apply
Remote or Hybrid
United States
175 Employees

UL Solutions Logo UL Solutions

Sales Executive

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Hybrid
Brea, CA, USA
15000 Employees
70K-109K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account