Senior AI Engineer (LLM & Distributed Systems)
We are building AI-powered backend platforms and are hiring a Sr. AI Engineer with backend/distributed-systems focused.
This is a hands-on engineering role focused on scalable backend architecture, LLM integration, and reliable AI system deployment.
What You’ll Work On
- Design and build scalable backend services and RESTful APIs using Python (FastAPI).
- Develop distributed, high-throughput, low-latency systems integrating AI/LLM services, SQL databases, and Kafka pipelines.
- Integrate and operationalize LLM solutions (prompt orchestration, evaluation, monitoring, caching, optimization).
- Build containerized services using Docker and deploy via Kubernetes.
- Ensure reliability, observability, performance, and security across production systems.
- Contribute to CI/CD pipelines and production deployment health.
- Collaborate cross-functionally with AI engineers, data teams, product, and business stakeholders.
- Write clean, modular, well-tested production code and participate in code reviews.
Education
- Bachelor’s degree in computer science, Software Engineering, or related field (or equivalent practical experience).
Required Experience
- 5+ years backend engineering experience.
- Deep expertise in Python and API development (FastAPI preferred).
- Strong experience with Kafka or event-driven architectures.
- Experience designing distributed, high-throughput systems.
- Experience integrating backend services with data platforms such as Databricks
- Strong debugging, performance optimization, and observability practices.
- Experience with Docker, Kubernetes, CI/CD pipelines.
- Experience working in distributed, cross-functional teams.
- Solid testing discipline (unit + integration).
- Excellent communication skills, able to explain technical decisions clearly to business and architecture stakeholders.
Nice to Have
- Experience defining system architecture and evaluating trade-offs.
- Cloud exposure (Azure DataBricks preferred).
- Experience in regulated environments (e.g., insurance).
- Full-stack exposure.
Chubb Canada does not use artificial intelligence (AI) tools to assess, screen, or select applicants.
At Chubb we are committed to providing equal employment opportunities to all employees and applicants. It is our policy to provide equal employment opportunities to employees and applicants based on job-related qualifications and ability to perform a job. If you require an accommodation during the hiring process or upon hire, please inform Human Resources. If a selected applicant requests accommodation during the recruitment process, Chubb will consult with the applicant in order to provide suitable accommodation that takes into account the applicant’s accessibility needs.
Top Skills
What We Do
Chubb is the world’s largest publicly traded property and casualty insurance company. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. As an underwriting company, we assess, assume and manage risk with insight and discipline. We service and pay our claims fairly and promptly. The company is also defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb maintains executive offices in Zurich, New York, London, Paris and other locations, and employs 31,000 people worldwide. Additional information can be found at: chubb.com.
.png)
