Want to see your work power millions of machine learning predictions every day? Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way.
You’ll contribute to a platform that trains thousands of models and serves hundreds of millions of queries daily, while growing your expertise in distributed systems, machine learning infrastructure and agentic workflows.
As a Backend Developer, you will:- Contribute to the development lifecycle, including coding, testing, and deployment
- Analyze and help improve the ease of use, observability and reliability of our AI platform
- Participate in maintaining services handling millions of requests and LLM calls per day
- Collaborate with applied scientists, data engineers, and developers to integrate agentic applications into production
- Contribute to evolving our AI platform to support the growth and scale of agentic workflows for Coveo users
- Suggest improvements to existing processes and use AI coding tools to support your development workflow
- 5+ years of experience in backend development in a cloud environment (Python or Java/Spring preferred, AWS an asset)
- Good understanding of distributed systems and scalable application design
- Ability to solve problems and debug systems with guidance when needed
- Comfortable learning new tools, technologies, and best practices
- Familiarity with Terraform, AWS Bedrock, OpenSearch serverless or other vector databases, LiteLLM or other LLM inference gateways
- Exposure to machine learning workflows or agentic workflows
- Interest in scalable backend services, large-scale realtime systems, agentic workflows and applications or realtime inference at scale
You don’t need to check every single box; passion goes a long way and we appreciate that skillsets are transferable.
Send us your application, we want to hear from you!
Join the Coveolife!
We encourage all qualified candidates to apply regardless of, for example, age, gender, disability, gaps in CV, national or ethnic background.
This job description was written by humans, assisted by AI. We may leverage technology in our hiring process to help us see the person behind the resume.
Coveo is committed to providing accessible employment practices. If you require accommodation due to a disability at any point during the recruitment process, please contact [email protected] to discuss your needs.
Skills Required
- 5+ years of experience in backend development in a cloud environment
- Experience with Python or Java/Spring
- Experience with AWS (cloud environment)
- Good understanding of distributed systems and scalable application design
- Ability to solve problems and debug systems with guidance when needed
- Comfortable learning new tools, technologies, and best practices
- Familiarity with Terraform
- Familiarity with AWS Bedrock
- Familiarity with OpenSearch Serverless or other vector databases
- Familiarity with LiteLLM or other LLM inference gateways
- Exposure to machine learning workflows or agentic workflows
- Interest in scalable backend services, realtime systems, and realtime inference at scale
Coveo Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Coveo and has not been reviewed or approved by Coveo.
-
Healthcare Strength — Healthcare is considered comprehensive and good value, spanning medical, dental, vision, disability, mental‑health support, telemedicine, and an EAP. This breadth and perceived affordability stand out across locations.
-
Leave & Time Off Breadth — Paid holidays, PTO/sick leave, volunteer time off, and work‑from‑home flexibility are commonly available. Flexible working hours and solid vacation policies in Canada further support work‑life balance.
-
Parental & Family Support — Parental‑leave top‑ups, options to extend leave, and on‑site daycare in Quebec City indicate robust family support. These provisions complement caregiver‑friendly flexibility in day‑to‑day scheduling.
Coveo Insights
What We Do
Coveo powers the digital experiences of the world’s most innovative brands serving millions of people and billions of interactions across every digital experience. After a decade of enriching our market-leading platform with forward-thinking global enterprises, we know what it takes to gain a trusted AI-experience advantage. We strongly believe that the future is business-to-person, that experience is today’s competitive front line, a make or break for every business. For enterprises to achieve this AI-experience advantage at scale, it is imperative to have an Enterprise Spinal and composable ability to deliver AI semantic search and generative experiences at each customer and employee interaction.
