Senior Software Engineer - AI Agents Testing

Posted Yesterday
Be an Early Applicant
3 Locations
In-Office
Senior level
Software
Zendesk is a service-first CRM company that builds software designed to improve customer relationships.
The Role
Build and maintain evaluation, synthetic testing, and validation tooling for AI agents. Design backend services, APIs, and event-driven test infrastructure, deliver polished front-end features, collaborate with cross-functional teams, and raise engineering quality while mentoring others.
Summary Generated by Built In
Job Description

At Zendesk, we’re on a mission to build the most advanced AI agents in CX, and the AI Agent Testing team within the AI Agents organization plays a critical role in ensuring those agents are reliable, robust, and ready to deliver real customer value. Our focus is on synthetic testing, evaluation workflows, validation frameworks, and tooling that help us measure quality, uncover failure modes, and ship with confidence.

As a Senior Fullstack Engineer on this team, you’ll be a key technical contributor shaping the systems, tooling, and workflows that power AI agent evaluation at scale. While this is a fullstack role, it leans more on backend development as we’re looking for someone who is deeply comfortable with APIs, event-driven systems, testing infrastructure, data workflows, and platform thinking, while also being able to design and deliver polished user-facing tools when needed.

You’ll collaborate closely with product managers, designers, data engineers, applied AI/ML partners, and fellow engineers to build internal and customer-facing capabilities that improve the quality of our AI agents. In this role, you’ll not only ship features end-to-end, but also help shape technical direction, raise the bar on engineering quality, and influence how the team solves complex problems.

Your work will directly impact how Zendesk validates and improves its AI agents, helping ensure our products are trustworthy, measurable, and effective.

What You Bring to the Role 
  • 5+ years of experience building modern web applications using TypeScript, React, and Node.js.

  • Strong experience designing and building backend services, APIs, and event-driven systems.

  • Strong understanding of software engineering best practices, including clean architecture, testing strategy, observability, and maintainability.

  • Experience working across the stack and delivering polished, performant, accessible user experiences.

  • Ability to independently drive complex projects from ambiguity to execution, while partnering effectively across functions.

  • Excellent communication skills, proactive mindset and the ability to influence technical decisions, align stakeholders, and mentor other engineers.

  • You are a product-minded engineer, you care deeply about the end-user experience and proactively contribute ideas to improve product outcomes.

  • Comfort working in fast-moving, cross-functional environments and iterating based on feedback.

  • A drive for continuous learning, reflection, and improvement, in both your own growth and your team’s success.

  • You are eager to expand into ML engineering and learn how it connects to evaluation, testing, and the lifecycle of AI systems.

A big plus if you
  • Are familiar with AWS, and comfortable with CI/CD pipelines.

  • Have a good understanding of microservice architecture, event-driven systems, and relational/NoSQL data modeling.

  • Have experience with AI agentic tools such as Cursor, Claude Code, and similar developer assistants.

  • Have experience with Python, especially for testing, automation, data processing, or scripting.

  • Have prior experience building evaluation systems, synthetic testing pipelines, or AI quality tooling.

How We Measure Success in This Role
  • You consistently deliver high-quality work on complex, ambiguous problems with minimal guidance.

  • You raise the technical bar through thoughtful architecture, strong testing practices, and reliable system design.

  • You help the team make better technical decisions by identifying tradeoffs and proposing pragmatic solutions.

  • You contribute to the reliability, scalability, and observability of the systems the team owns.

  • You collaborate effectively across product, design, AI/ML, and data, and help align stakeholders around technical direction.

  • You mentor and support other engineers through code reviews, design discussions, and day-to-day collaboration.

  • You demonstrate strong ownership by driving work forward, surfacing risks early, and helping the team execute with confidence.

Our Tech Stack
  • Frontend: TypeScript, React

  • Backend: Node.js (ES7+), TypeScript, MongoDB, Snowflake

  • Infrastructure: AWS, Kubernetes, Terraform, ArgoCD, Sentry, Redis, Datadog, GitHub Actions

Interview ProcessWe aim to make our hiring process clear and transparent:
  • Intro chat with Talent Partner – 30 minutes

  • Interview with Hiring Manager – 45 minutes

  • Technical stage is a theoretical interview + a live coding challenge – two times 60 minutes

  • Final interview with Hiring Manager and Senior Leadership – 45 minutes

#LI-JJ2

The intelligent heart of customer experience

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to [email protected] with your specific accommodation request.

Skills Required

  • 5+ years building modern web applications using TypeScript, React, and Node.js
  • Strong experience designing and building backend services, APIs, and event-driven systems
  • Strong understanding of software engineering best practices including clean architecture, testing strategy, observability, and maintainability
  • Experience working across the stack and delivering polished, performant, accessible user experiences
  • Ability to independently drive complex projects from ambiguity to execution and align stakeholders
  • Excellent communication skills, proactive mindset, and ability to mentor other engineers
  • Product-minded engineering approach with focus on end-user experience
  • Eagerness to expand into ML engineering and connect evaluation to AI lifecycle
  • Familiarity with AWS and comfort with CI/CD pipelines
  • Understanding of microservice architecture, event-driven systems, and relational/NoSQL data modeling
  • Experience with AI agentic tools (e.g., Cursor, Claude Code) or similar developer assistants
  • Experience with Python for testing, automation, or data processing
  • Prior experience building evaluation systems, synthetic testing pipelines, or AI quality tooling

Zendesk Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Zendesk and has not been reviewed or approved by Zendesk.

  • Fair & Transparent Compensation The company states a commitment to publishing base pay ranges and advancing pay equity, helping employees gauge fairness. Public messaging on pay equity and transparency signals structured, consistent compensation practices.
  • Leave & Time Off Breadth Time away programs include flexible PTO, dedicated well‑being days, emergency time off, and pregnancy loss leave. Parental leave is described as generous, and travel support exists for reproductive care where access is restricted.
  • Healthcare Strength Benefits language highlights comprehensive medical, dental/vision, mental health access, and an employee assistance program. These offerings are positioned as part of holistic wellbeing support across regions.

Zendesk Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
6,277 Employees
Year Founded: 2007

What We Do

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love. We advocate for digital first customer experiences— and we stick with it in our workplace. Over 5,000 employees worldwide are collaborating from kitchen tables, home offices, co-working spaces, and Zendesk workspaces to make one team.

Why Work With Us

We know one desk doesn’t fit all. At Zendesk, we prioritize remote work because we believe great work happens anywhere. Digital first is more than where we work though. We give our employees flexibility and choice in both where and how they work while also trusting them to be a team player.

Gallery

Gallery

Similar Jobs

Cloudflare Logo Cloudflare

Deal Desk Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Lisbon, PRT
4400 Employees
54K-68K Annually

Mastercard Logo Mastercard

Consultant

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Lisbon, PRT
38800 Employees

Mastercard Logo Mastercard

Commercialization Manager - Sale Synergy

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Lisbon, PRT
38800 Employees

HiBob Logo HiBob

Customer Success Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Portugal
1350 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account