Engineering Manager, AI/ML Infrastructure & GenAI Platforms

Sorry, this job was removed at 08:13 a.m. (CST) on Friday, Jan 09, 2026
Be an Early Applicant
2 Locations
In-Office or Remote
Software
Zendesk is a service-first CRM company that builds software designed to improve customer relationships.
The Role
Job Description

Zendesk’s people have one goal in mind: to make Customer Experience better. Our products help more than 125,000 global brands make their billions of customers happy, every day.

The AI/ML Platform team is at the forefront of this mission. We build the foundation that powers every AI-driven experience at Zendesk, enabling product teams to build, evaluate, and deploy state-of-the-art Large Language Model (LLM) applications reliably and at scale.

We're looking for an Engineering Manager to lead the next wave of GenAI infrastructure at Zendesk. This includes our internal LLM Proxy, benchmarking framework, Data annotations and agentic workflow orchestration tools. You’ll empower Zendesk’s ML/AI teams by building secure, cost-optimized, and developer-friendly ML platforms that scale across use cases and products.

You'll work with different partners (Engineering, Product, Architects and Tech Leads) to ensure your team's roadmap is aligned with company strategy and the team is shipping architecturally sound software at a regular cadence.

What you get to do every day
  • Lead a high-performing team of AI/ML platform engineers to deliver the core infrastructure powering LLM-based applications.

  • Own the design, rollout, and optimization of Zendesk’s LLM Proxy, enabling safe, observable, and cost-efficient access to multiple foundation models.

  • Collaborate with existing ML/AI leadership to continually improve software delivery and service reliability.

  • Partner with applied ML, product, and infrastructure teams to align platform investments with AI roadmap priorities.

  • Establish strong engineering practices around observability, reliability, security, and cost monitoring.

  • Foster a team culture that emphasizes mentorship, inclusion, and technical excellence.

What you bring to the role
  • Proven experience managing high-performing engineering teams in the ML/AI or infrastructure space.

  • Deep understanding of LLM systems, GenAI applications, or ML/AI platform components such as vector databases, serving layers, and orchestration tools.

  • Experience owning the full lifecycle of ML/AI platform components—from early design to production deployment.

  • Strong communication skills and an ability to influence technical direction across teams and partners.

  • A pragmatic mindset: you balance innovation with scalability and performance in enterprise environments.

  • A dedication to continual self-development.

  • Collaborative, upbeat work ethic where you can take ownership and have fun.

What our tech stack looks like
  • Our code is written in Python.

  • Our servers live in AWS.

  • LLM Vendors: OpenAI, Anthropic, Google, Llama

  • Infra: Kubernetes, Docker, Kafka, AWS 

What we offer
  • Full ownership of the projects you work on.

  • What you will be doing will have a huge impact.

  • Team of passionate people who love what they do.

  • Exciting projects, ability to implement your own ideas and improvements.

  • Opportunity to learn and grow.

...and everything you need to be effective and maintain work-life balance

  • Flexible working hours.

  • Professional development funds.

  • Comfortable office and a remote setup.

  • Choice of your laptop and other equipment.

  • Premium Medical Insurance as well as Private Life Assurance.
     

#LI-BP1

Hybrid: In this role, our hybrid experience is designed at the team level to give you a rich onsite experience packed with connection, collaboration, learning, and celebration - while also giving you flexibility to work remotely for part of the week. This role must attend our local office for part of the week. The specific in-office schedule is to be determined by the hiring manager.

The intelligent heart of customer experience

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to [email protected] with your specific accommodation request.

Similar Jobs

Cloudflare Logo Cloudflare

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
2 Locations
4400 Employees

GitLab Logo GitLab

Security Engineer

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
In-Office or Remote
36 Locations
2500 Employees

Clipboard Health Logo Clipboard Health

Client Support Specialist

Edtech • Healthtech • Information Technology • Hospitality
Remote
7 Locations
700 Employees

Mondelēz International Logo Mondelēz International

Product Owner

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
38 Locations
90000 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
6,277 Employees
Year Founded: 2007

What We Do

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love. We advocate for digital first customer experiences— and we stick with it in our workplace. Over 5,000 employees worldwide are collaborating from kitchen tables, home offices, co-working spaces, and Zendesk workspaces to make one team.

Why Work With Us

We know one desk doesn’t fit all. At Zendesk, we prioritize remote work because we believe great work happens anywhere. Digital first is more than where we work though. We give our employees flexibility and choice in both where and how they work while also trusting them to be a team player.

Gallery

Gallery

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account