Senior AI Systems Engineer

Posted 2 Days Ago
Be an Early Applicant
Toronto, ON, CAN
Hybrid
83K-114K Annually
Senior level
Software
The Role
Build and operate production ML and GenAI systems, including data pipelines, model serving, RAG applications, agents, evaluation frameworks, guardrails, monitoring, and MLOps practices. Translate business needs into technical plans, optimize performance and cost, conduct design and code reviews, troubleshoot pipelines, and mentor engineers while collaborating with product managers, data scientists, and engineering leaders.
Summary Generated by Built In
Meet Benevity

Benevity is the way the world does good, providing companies (and their employees) with technology to take social action on the issues they care about. Through giving, volunteering, grantmaking, employee resource groups and micro-actions, we help most of the Fortune 100 brands build better cultures and use their power for good. We’re also one of the first B Corporations in Canada, meaning we’re as committed to purpose as we are to profits. We have people working all over the world, including Canada, Spain, Switzerland, the United Kingdom, the United States and more!

Benevity’s software architecture has evolved to include a diverse technology stack. The front-end application, using mainly VueJS, is designed for both desktop and mobile web rendering. Our back-end systems (some Java SpringBoot, some PHP) manage data processing, interfaces with external providers, and ensures robust security. We run and operate our systems in both GCP and AWS cloud, leveraging where possible cloud-native technology. We emphasize clean, maintainable code and use GIT for version control and collaboration. Additionally, our platform integrates with various external services for functionalities like email communication, content storage, and server-to-server interactions.

Our culture is driven by our core value of “we-are-we” and as a Senior AI Systems Engineer, you will work in an outcome-driven environment where collaboration with your product, design and engineering counterparts is paramount.

If you’re eager to make a difference and thrive in a collaborative setting, we invite you to join our team!

Position Overview:

As a Senior AI Systems Engineer, you'll build and run the machine learning and GenAI systems that power Benevity's products. You'll turn promising prototypes into reliable, production-grade features that help impact leaders do more good. You'll own significant systems from design through monitoring, work closely with data scientists and product managers, and help raise the bar for the engineers around you. You'll work closely with the Staff engineers on architecture and strategy, and lead delivery in your own area.


What you’ll do:

  • Design, build and operate ML and GenAI features end to end, from data ingestion and feature pipelines to model serving and monitoring.

  • Build LLM-powered applications such as search, assistants and agents, including RAG pipelines, tool integrations and multi-step workflows.

  • Create evaluation frameworks for GenAI systems that combine offline benchmarks, online metrics and human review.

  • Implement guardrails for GenAI applications, including prompt injection defenses, hallucination mitigation and responsible AI practices.

  • Put MLOps standards into practice: versioning, automated testing, A/B testing, drift detection and safe rollbacks.

  • Translate business problems from product managers and data scientists into clear technical requirements and scoped delivery plans.

  • Write design docs, take part in design reviews and give thoughtful code reviews.

  • Mentor mid-level engineers on production ML practices and system design.

  • Balance latency, cost and quality when choosing models, prompts and infrastructure.

  • Find and fix bottlenecks in pipelines, serving and platform performance.

What you’ll bring:

  • Bachelor's or Master's degree in Computer Science, Mathematics or a related field, or equivalent professional experience.

  • 5+ years of software engineering experience, including 3+ years building and deploying ML models in production.

  • Hands-on experience across the ML lifecycle: training, evaluation, deployment, monitoring and retraining.

  • Strong Python skills and experience with ML frameworks such as PyTorch, TensorFlow or scikit-learn.

  • Experience with at least one major cloud platform (AWS, Azure or Google Cloud) and with distributed workloads.

  • Working knowledge of data pipelines, feature engineering and large-scale data processing.

  • Familiarity with ML tooling such as experiment tracking, model registries, feature stores or orchestration frameworks.

  • Experience with CI/CD for ML, including automated validation and rollback strategies.

  • Experience shipping LLM-based features, including prompt engineering, few-shot techniques and tool or function calling.

  • Experience building RAG systems, including embeddings, vector databases and retrieval tuning.

  • Exposure to agentic workflows and orchestration frameworks such as LangChain, LlamaIndex or ADK.

  • Solid grasp of APIs, microservices and reliability fundamentals.

  • Awareness of data governance, privacy, bias and explainability in AI systems.

  • Clear communication and a collaborative approach with technical and non-technical partners.

Great-to-haves:

  • Certification in relevant cloud platforms or technologies.

Discover your purpose at work

We’re not employees, we’re Benevity-ites. From all locations, backgrounds and walks of life, who deserve more …

Innovative work. Growth opportunities. Caring co-workers. And a chance to do work that fills us with a sense of purpose.

If the idea of working on tech that helps people do good in the world lights you up ... If you want a career where you’re valued for who you are and challenged to see who you can become …

It’s time to join Benevity. We’re so excited to meet you.

Where We Work

At Benevity, we embrace a flexible hybrid approach to where we work that empowers our people in a way that supports great work, strong relationships, and personal well-being. For those located near one of our offices, while there’s no set requirement for in-office time, we do value the moments when coming together in person helps us build connection and collaboration. Whether it’s for onboarding, project work, or a chance to align and bond as a team, we trust our people to make thoughtful decisions about when showing up in person matters most.

Join a company where DEIB isn’t a buzzword

Diversity, equity, inclusion and belonging are part of Benevity’s DNA. You’ll see the impact of our massive investment in DEIB daily — from our well-supported employee resources groups to the exceptional diversity on our leadership and tech teams.

We know that diverse backgrounds, experiences, skills and passions are what move our business and our people forward, so we're committed to creating a culture of belonging with equal opportunities for everyone to shine.

That starts with a fair and accessible hiring process. If you want to feel seen, heard and celebrated, you belong at Benevity.

Candidates with disabilities who may require accommodations throughout the hiring or assessment process are encouraged to reach out to [email protected].

Skills Required

  • Bachelor’s or Master’s degree in Computer Science, Mathematics, or a related field, or equivalent professional experience
  • 5+ years of software engineering experience
  • 3+ years building and deploying machine learning models in production
  • Hands-on experience across the ML lifecycle, including training, evaluation, deployment, monitoring, and retraining
  • Strong Python skills
  • Experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn
  • Experience with at least one major cloud platform: AWS, Azure, or Google Cloud
  • Experience with distributed workloads
  • Working knowledge of data pipelines, feature engineering, and large-scale data processing
  • Familiarity with ML tooling such as experiment tracking, model registries, feature stores, or orchestration frameworks
  • Experience with CI/CD for ML, including automated validation and rollback strategies
  • Experience shipping LLM-based features, including prompt engineering, few-shot techniques, and tool or function calling
  • Experience building RAG systems, including embeddings, vector databases, and retrieval tuning
  • Exposure to agentic workflows and orchestration frameworks such as LangChain, LlamaIndex, or ADK
  • Solid understanding of APIs, microservices, and reliability fundamentals
  • Awareness of data governance, privacy, bias, and explainability in AI systems
  • Clear communication and collaborative approach with technical and non-technical partners
  • Certification in relevant cloud platforms or technologies
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Calgary, Alberta
818 Employees
Year Founded: 2008

What We Do

Benevity is the global social impact software with an all-in-one platform for corporate grantmaking, volunteering, giving, micro-actions and employee resource groups. A certified B Corporation and recognized in Fortune's Impact 20, we empower iconic brands to attract, retain and engage diverse workforces, embed social action in customer experiences, support communities and understand their impact in the world. Since our inception, Benevity has helped businesses around the world donate over $14 billion, track 72 million volunteer hours and support communities with over $19 billion in grants

Similar Jobs

Movable Ink Logo Movable Ink

Senior Back-end Engineer

Artificial Intelligence • Marketing Tech • Software
Easy Apply
Remote or Hybrid
Toronto, ON, CAN
600 Employees
143K-200K Annually

Nexxa.ai Logo Nexxa.ai

Senior Software Development Engineer In Test

Artificial Intelligence • Software • Industrial • Automation
In-Office or Remote
Toronto, ON, CAN
30 Employees
In-Office
Toronto, ON, CAN
27791 Employees

Movable Ink Logo Movable Ink

Senior Data Engineer

Artificial Intelligence • Marketing Tech • Software
Easy Apply
Hybrid
Toronto, ON, CAN
600 Employees
144K-188K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account