Staff Software Engineer - AI Copilot (Backend)

Posted 3 Days Ago
Be an Early Applicant
2 Locations
In-Office or Remote
Senior level
Software
Zendesk is a service-first CRM company that builds software designed to improve customer relationships.
The Role
Lead the architecture and delivery of Zendesk’s conversational AI backend, including LLM orchestration, intent detection, context retrieval, tool execution, evaluation frameworks, guardrails, and safety mechanisms. Own complex features from design through production, drive technical direction across teams, improve system reliability and scalability, collaborate with product and ML teams, and mentor engineers.
Summary Generated by Built In
Job Description

Job Summary
At Zendesk, our focus is helping our customers build great relationships with their customers. Founded by three Danish entrepreneurs, Zendesk has experienced remarkable success and growth while maintaining a fun, positive, and down-to-earth culture.
We are looking for a Staff Engineer to join our AI Copilot organisation. AI Copilot is a multi-million ARR product that puts AI directly into the hands of customer service agents and administrators. You will be a technical leader driving the architecture and delivery of our conversational AI backend — the system that enables admins to configure and optimize Zendesk through natural language.
We ship to learn: our philosophy is to deliver early, deliver often, and iterate based on real-world customer feedback.
What you'll be doing

  • Drive the technical vision and architecture for the Admin Copilot Conversational backend — LLM orchestration, intent detection, context retrieval, and tool execution.
  • Own end-to-end delivery of complex, cross-cutting features — from technical design through implementation, release, and production operation.
  • Be a hands-on technical leader: set engineering standards, make key architecture decisions, and ensure the team builds reliable, scalable systems.
  • Collaborate closely with ML Scientists, Product Management, Design, and partner engineering teams to shape the product roadmap from a technical perspective.
  • Influence technical direction beyond your team — contribute to architecture decisions across the Copilot organisation and adjacent teams.
  • Design and improve evaluation frameworks, guardrails, and safety mechanisms for LLM-powered features in production.
  • Mentor and grow engineers on the team through technical guidance, code review, and pairing. Raise the bar for engineering quality.
  • Identify and address systemic technical risks, performance bottlenecks, and reliability gaps before they become customer-facing problems.

What you bring to the role
Required

  • 8+ years of experience in software engineering, with demonstrated technical leadership in backend systems.
  • Strong experience designing and building distributed systems at scale — APIs, service architectures, and data pipelines.
  • Experience with LLM integration in production systems — orchestration, prompt engineering, evaluation, guardrails, or multi-provider setups.
  • Fluent in at least one backend language (Ruby, Python, Go, or similar); working proficiency across multiple languages.
  • Deep understanding of cloud infrastructure (AWS), containerised deployments (Docker, Kubernetes), and CI/CD practices.
  • A track record of driving technical direction for a team or project — architecture decisions, technical roadmaps, and cross-team alignment.
  • Ability to operate effectively with ambiguity — you can break down complex problems, make pragmatic tradeoffs, and move fast without sacrificing quality.
  • Strong collaboration and communication skills — you influence through technical credibility and clear articulation of tradeoffs, not authority.


Preferred

  • Experience building conversational AI or chat-based systems (intent detection, context management, tool use).
  • Experience with ML infrastructure: model serving, inference pipelines, or evaluation frameworks.
  • Familiarity with ML pipeline tooling (e.g., Metaflow) and experiment tracking (e.g., MLflow).
  • Experience with event-driven architectures (e.g., Kafka).
  • Experience with SQL and data infrastructure (Snowflake, dbt).
  • Experience mentoring or technically leading a team of 3+ engineers.


Tech Stack

  • Our code is written in Ruby and Python
  • Our servers live in AWS
  • Our ML pipelines use Metaflow
  • Our data is stored in S3, RDS MySQL, and Snowflake (with dbt for transformations)
  • Our services and models are deployed to Kubernetes using Docker
  • Heavy usage of LLM technology from multiple providers via our LLM Proxy
  • Our conversational backend uses the Vercel AI SDK for LLM orchestration

The intelligent heart of customer experience

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to [email protected] with your specific accommodation request.

Skills Required

  • 8+ years of software engineering experience with demonstrated technical leadership in backend systems
  • Experience designing and building distributed systems at scale, including APIs, service architectures, and data pipelines
  • Production experience integrating LLMs, including orchestration, prompt engineering, evaluation, guardrails, or multi-provider setups
  • Fluency in at least one backend language, such as Ruby, Python, or Go, with working proficiency across multiple languages
  • Deep understanding of AWS, Docker, Kubernetes, and CI/CD practices
  • Track record of driving technical direction through architecture decisions, technical roadmaps, and cross-team alignment
  • Ability to operate effectively with ambiguity and make pragmatic technical tradeoffs
  • Strong collaboration and communication skills
  • Experience building conversational AI or chat-based systems
  • Experience with ML infrastructure, including model serving, inference pipelines, or evaluation frameworks
  • Familiarity with Metaflow and MLflow
  • Experience with event-driven architectures such as Kafka
  • Experience with SQL and data infrastructure such as Snowflake and dbt
  • Experience mentoring or technically leading a team of three or more engineers

Zendesk Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Zendesk and has not been reviewed or approved by Zendesk.

  • Fair & Transparent Compensation — The company states a commitment to publishing base pay ranges and advancing pay equity, helping employees gauge fairness. Public messaging on pay equity and transparency signals structured, consistent compensation practices.
  • Leave & Time Off Breadth — Time away programs include flexible PTO, dedicated well‑being days, emergency time off, and pregnancy loss leave. Parental leave is described as generous, and travel support exists for reproductive care where access is restricted.
  • Healthcare Strength — Benefits language highlights comprehensive medical, dental/vision, mental health access, and an employee assistance program. These offerings are positioned as part of holistic wellbeing support across regions.

Zendesk Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
6,277 Employees
Year Founded: 2007

What We Do

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love. We advocate for digital first customer experiences— and we stick with it in our workplace. Over 5,000 employees worldwide are collaborating from kitchen tables, home offices, co-working spaces, and Zendesk workspaces to make one team.

Why Work With Us

We know one desk doesn’t fit all. At Zendesk, we prioritize remote work because we believe great work happens anywhere. Digital first is more than where we work though. We give our employees flexibility and choice in both where and how they work while also trusting them to be a team player.

Gallery

Gallery

Similar Jobs

Celonis Logo Celonis

Senior Value Engineer (Pharma) - AI & Process Optimization (Copenhagen)

Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Remote or Hybrid
Portugal
3000 Employees

Rain Logo Rain

Account Manager

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Remote
27 Locations
100 Employees

Circle (circle.so) Logo Circle (circle.so)

Lead Engineer, Member Growth

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
54 Locations
250 Employees

Bose Logo Bose

Scientist

Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Remote or Hybrid
Lisbon, PRT
2900 Employees
165K-228K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account