Senior Software Developer, ML Platform & Infrastructure

Posted 6 Days Ago
Be an Early Applicant
Headquarters, AZ, USA
In-Office
152K-189K Annually
Senior level
Financial Services
The Role
Build and operate Wealthsimple’s ML and LLM platform infrastructure. Responsibilities include designing model-routing systems, scaling GPU workloads on Kubernetes, managing LLM serving with vLLM and related tools, developing evaluation and observability frameworks, enabling self-serve ML tooling, and optimizing inference cost, latency, reliability, and model performance across cloud and self-hosted environments.
Summary Generated by Built In
Build something people love

Wealthsimple is Canada’s leading financial innovator. The company offers a full suite of simple, sophisticated financial products across managed investing, do-it-yourself trading, cryptocurrency, tax filing, spending and saving. Wealthsimple currently serves more than 4 million Canadians and holds over $155 billion in assets under administration. The company was founded in 2014 by a team of financial experts and technology entrepreneurs, and is headquartered in Toronto, Canada.

We're proud of what we've built — and we're just getting started. Read our Culture Manual and learn more about how we work.

ML Platform & Infrastructure Team

The Machine Learning Infrastructure & Platform team builds the foundational architecture powering AI and GenAI initiatives across Wealthsimple. We sit at the intersection of production MLOps and cutting-edge GenAI enablement.

As our AI footprint expands rapidly, our priority is evolving our robust MLOps foundations into a scalable, high-performance LLM serving and routing platform. We build self-serve systems that allow Data Scientists and Engineers to host open-source LLMs reliably, optimize inference latencies, manage GPU infrastructure, and benchmark model performance safely in production.

The Role

We are looking for an experienced MLOps or ML Platform Engineer who is excited to pivot their deep background in model orchestration, serving, and platform tooling toward solving the unique challenges of LLM inference and infrastructure.

In this role, you will bridge the gap between traditional MLOps (model lifecycles, pipeline orchestration, serving infrastructure) and modern GenAI stack requirements (vLLM, GPU cluster management, intelligent model routing, and automated Evals). You will take end-to-end ownership of setting the technical direction for operating enterprise-grade LLM systems company-wide.

In this role, you will have the opportunity to:
  • Turn MLOps expertise to GenAI: Transition traditional ML lifecycle and serving patterns into state-of-the-art LLM inference engines and GPU orchestration systems.

  • Build model-routing architecture: Design low-latency routing frameworks (e.g., LiteLLM integration) to dynamically direct requests across managed cloud providers (AWS Bedrock) and self-hosted open-source models.

  • Provision & scale GPU infrastructure: Architect and manage high-performance GPU serving environments on Kubernetes using engines like vLLM, Ray, and Triton.

  • Develop evaluation & benchmarking tooling: Build automated Evals and observability frameworks to empower engineers and data scientists to validate model quality, latency, and drift against production requirements.

  • Empower self-serve ML across Wealthsimple: Partner with product engineering and data science teams to build framework-agnostic platform tooling that abstracts infrastructure complexity.

  • Drive cost & performance optimization: Improve price-performance across self-hosted and managed inference by optimizing capacity, utilization, batching, routing, and model selection while meeting quality and reliability objectives

We are looking for people who have:
  • 7+ years of software engineering experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering.

  • Deep experience in MLOps/ML Platform practices: Proven track record building and operating self-serve ML platforms, model registry workflows, experiment tracking, or production serving infrastructure (Kubeflow, MLflow, Ray, Triton, SageMaker).

  • Strong platform fundamentals: Advanced proficiency in Python, container orchestration via Kubernetes, infrastructure-as-code (Terraform), and cloud provider ecosystem (AWS).

  • Strong appetite to specialize in LLM serving: A genuine desire to leverage your existing MLOps skillset to tackle LLM-specific challenges (vLLM, model routing, prompt engineering tooling, vector databases, GPU memory optimization, or LLM evaluation frameworks).

  • Backend performance & observability focus: Experience designing highly available, observable microservices (e.g., FastAPI) handling real-time, low-latency requests.

  • End-to-end technical ownership: Proven capability to lead architectural roadmaps, guide multi-functional projects with high autonomy, and maintain complex platform systems for the long run.

Nice-to-haves (or areas you will learn on the job):
  • Direct experience serving open-source Large Language Models in production (vLLM, SGLang, TensorRT-LLM, Dynamo).

  • Hands-on work with CUDA, GPU partitioning, or distributed inference frameworks (Ray Serve).

  • Familiarity with vector search and retrieval engines (Elasticsearch, Qdrant, Pinecone).

Our Stack Includes:
  • Container & Infrastructure: Kubernetes, Terraform, AWS GPU Infrastructure

  • ML Serving & LLM Tooling: vLLM, Ray, Triton, LiteLLM, AWS Bedrock, MLflow, SageMaker

  • Languages & Frameworks: Python, FastAPI, PyTorch

  • Data & Streaming: Kafka, Postgres, Redshift, Snowflake

Why Wealthsimple?

🌸 Top-tier health benefits and life insurance

📈 Long-term group savings with employer match, through Wealthsimple for Business

🌴 20 vacation days, 4 wellness days, and unlimited sick and mental health days per year*

✈️ 90 days away: work outside Canada for up to 90 days per year*

👥 Employee resource groups, including Rainbow (2SLGBTQ), Women of WS, and Black at WS

🌎 We are a hybrid team with over 1,500 employees across North America. The people are one of the best parts of working here: you'll collaborate with incredibly talented, curious, and driven teammates who are deeply committed to doing great work.
*Unlimited paid sick days, Wellness Days and the 90 day away program do not apply to certain roles.

ICYMI

Technology & Innovation at Wealthsimple: We move quickly and build thoughtfully. That means we're always looking for better ways to work — whether that's new tools, AI, or rethinking how we approach a problem. We don't expect you to have all the answers, but we do expect curiosity and a willingness to evolve alongside the products we're building.

Inclusion Statement: We're building products for a diverse world, and we need a diverse team to do it well. We strongly encourage applications from everyone, regardless of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Accessibility Statement: We're committed to an accessible hiring experience. If you need any accommodations throughout the interview process, please let us know — we'll work with you to make sure you have what you need. We also welcome any feedback on how we can better accommodate candidates with accessibility needs.

AI in Hiring: We may use artificial intelligence (AI) tools to support parts of our hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our team but don't replace human judgment – all final hiring decisions are made by people. If you have questions about how your data is used, reach out to us.

Skills Required

  • 7+ years of software engineering experience in ML infrastructure, MLOps, ML tooling, or data platform engineering
  • Deep experience building and operating self-serve ML platforms, model registry workflows, experiment tracking, or production serving infrastructure
  • Advanced proficiency in Python
  • Experience with Kubernetes container orchestration
  • Experience with Terraform infrastructure as code
  • Experience with AWS cloud services and infrastructure
  • Experience designing highly available, observable microservices handling real-time, low-latency requests
  • Experience with backend performance and observability
  • Ability to lead architectural roadmaps and multifunctional projects with high autonomy
  • Ability to maintain complex platform systems over the long term
  • Production experience serving open-source large language models using technologies such as vLLM, SGLang, TensorRT-LLM, or Dynamo
  • Hands-on experience with CUDA, GPU partitioning, or distributed inference frameworks such as Ray Serve
  • Familiarity with vector search and retrieval engines such as Elasticsearch, Qdrant, or Pinecone

Wealthsimple Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Wealthsimple and has not been reviewed or approved by Wealthsimple.

  • Leave & Time Off Breadth — Time off programs include generous vacation, unlimited sick and mental health days, and a “90 Days Away” option to work internationally. These policies signal broad flexibility and ample opportunities for rest and renewal.
  • Parental & Family Support — Paid parental leave is topped up to full salary for extended periods for both primary and secondary caregivers. Structured reboarding and gradual return options reinforce support for growing families.
  • Wellbeing & Lifestyle Benefits — Offerings include a substantial mental health budget, Headspace access, wellness and home office stipends, and a remote‑friendly setup. These benefits emphasize whole‑person wellbeing beyond core pay and insurance.

Wealthsimple Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto
1,046 Employees
Year Founded: 2014

What We Do

All of your investing, made simple. wsim.co/legal

Similar Jobs

Applied Systems Logo Applied Systems

Senior Product Manager

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
110K-150K Annually

PwC Logo PwC

Program Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
65 Locations
370000 Employees
99K-232K Annually

PwC Logo PwC

Program Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
65 Locations
370000 Employees
77K-202K Annually

PwC Logo PwC

AWM - Digital Assets Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
68 Locations
370000 Employees
119K-337K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account