Senior Lead Machine Learning Engineer, Agentic AI

Posted 3 Days Ago
Easy Apply
Be an Early Applicant
Toronto, ON
Hybrid
Senior level
Cloud • HR Tech • Professional Services • Software
Upwork is the world’s work marketplace connecting businesses with independent talent.
The Role
Lead the development of AI agents, focus on LLM training and evaluation, architect the agentic platform backend, and provide technical leadership across teams.
Summary Generated by Built In

Upwork Inc.’s (Nasdaq: UPWK) family of companies connects businesses with global, AI-enabled talent across every contingent work type including freelance, fractional, and payrolled. This portfolio includes the Upwork Marketplace, which connects businesses with on-demand access to highly skilled talent across the globe, and Lifted, which provides a purpose-built solution for enterprise organizations to source, contract, manage, and pay talent across the full spectrum of contingent work. From Fortune 100 enterprises to entrepreneurs, businesses rely on Upwork Inc. to find and hire expert talent, leverage AI-powered work solutions, and drive business transformation. With access to professionals spanning more than 10,000 skills across AI & machine learning, software development, sales & marketing, customer support, finance & accounting, and more, the Upwork family of companies enables businesses of all sizes to scale, innovate, and transform their workforces for the age of AI and beyond.

Since its founding, Upwork Inc. has facilitated more than $30 billion in total transactions and services as it fulfills its purpose to create opportunity in every era of work. Learn more about the Upwork Marketplace at Upwork.com

Upwork ($UPWK) is the world’s human and AI-powered work marketplace that connects businesses with highly skilled, AI-enabled independent talent from across the globe. From entrepreneurs to Fortune 100 enterprises, companies rely on Upwork’s trusted platform and its mindful AI companion, Uma, to find and hire expert talent, leverage AI-powered work solutions, and drive business transformation. With on-demand access to professionals spanning more than 10,000 skills across AI & machine learning, software development, sales & marketing, customer support, finance & accounting, and more, Upwork enables businesses of all sizes to scale, innovate, and build agile teams for the age of AI and beyond.

Upwork’s platform has facilitated more than $25 billion in economic opportunity for talent around the world. Learn more at Upwork.com and follow us on LinkedIn, Facebook, Instagram, TikTok, and X.

We’re seeking a Senior Lead Machine Learning Engineer to architect, ship, and scale the next generation of agentic intelligence across Upwork. You will lead end‑to‑end development of AI agents and the platform that powers them—from LLM training and evaluation to runtime orchestration, safety, and developer APIs. This is a hands‑on, high‑impact role at the intersection of applied research and platform engineering, enabling internal teams and external developers to build reliable, safe, and high‑performing agents on Upwork.

Responsibilities
  • Build Agentic Intelligence.  Design and implement multi‑agent systems (planning, tool‑use, memory, debate/critique, reflection) with robust guardrails and recovery strategies.
  • Develop protocol‑aware agents and services that interoperate cleanly with developer tooling (e.g., agent frameworks and protocols such as MCP). 
  • Own reliability at scale: deterministic execution where needed, idempotency, timeouts/retries, and evaluation‑driven iteration on agent behavior.
  • Train, Align, and Evaluate LLMs for Agents.  Lead data strategy and curation for agent tasks; drive SFT, DPO, RLHF/RLAIF, and safety tuning tailored to multi‑tool, multi‑step workflows.
  • Stand up evaluation harnesses for functional, task, and longitudinal metrics (success rate, time‑to‑completion, hallucination/escape rates, cost/latency).
  • Build policy‑driven guardrails; partner with Legal/Security on data governance and privacy.
  • Engineer Agentic Platform Backend Infrastructure.  Architect low‑latency inference, retrieval, and orchestration services (streaming, event‑driven pipelines; scalable queues; caching; batching) with strong SLOs.
  • Ship production‑grade services (APIs/SDKs, auth, rate limiting, observability) that make agent features easy to integrate for internal and external developers. 
  • Optimize cost/performance via quantization, distillation, model‑routing, and autoscaling; integrate evaluation signals directly into runtime and CI/CD.
  • Lead, Partner, and Uplevel the Ecosystem.  Provide technical leadership across research, product, and platform teams; mentor senior ICs; influence roadmaps with clear metrics and trade‑offs.
  • Publish internal guidance and exemplar implementations; contribute to technical content, samples, and reference architectures for our agent platform. 
  • Define and track KPIs for data/quality/throughput, and drive continuous improvement using experiment results and production telemetry.
What it takes to catch our eye
  • Senior level experience applied ML/ML systems, with experience building LLM‑powered products; proven delivery of agentic workflows in production.
  • Hands‑on mastery of LLM adaptation (prompting, tool/function calling), data curation, and safety/guardrails.
  • Strong software fundamentals (distributed systems, transactions, consistency, resiliency) and experience building high‑throughput microservices/APIs/SDKs.
  • Fluency with Python; proficiency in one of Go/Java/Javascript a plus. Experience with container orchestration, messaging/streaming, and observability stacks.
  • Experience designing eval suites for agents (task/rubric‑based, offline/online) and closing the loop from evals → training → runtime policy.
  • Comfort with cost, latency, and reliability trade‑offs; you use metrics to make crisp decisions under ambiguity.
  • Familiarity with agent frameworks and protocols (e.g., MCP; API/SDK design for developer productivity).
  • Track record of leading cross‑functional initiatives and mentoring senior engineers; excellent written communication and bias for measurable results.
Come change how the world works.

Upwork is establishing its first international operational hub in Lisbon, Portugal. The new office is expected to be fully operational by Q4 2026.

This position will initially be employed through a partner to ensure a seamless hiring process while we establish the hub. Once the hub is established, there may be opportunities to transition to employment with Upwork depending on business needs and other requirements. While employed by the partner, you’ll work as part of Upwork’s team, with access to our resources, culture, and growth opportunities.

Our partner will offer competitive benefits. When Upwork’s hub is established, we will be excited to offer employment and benefits directly as business needs require. 

Upwork is committed to building a diverse, inclusive, and equitable workforce. Employment decisions are made without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, or any other status protected by applicable law.

To learn more about how Upwork processes and protects your personal information as part of the application process, please review our Global Job Applicant Privacy Notice

Top Skills

Go
Java
JavaScript
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
0 Employees
Year Founded: 2004

What We Do

Upwork is the world’s work marketplace, connecting millions of businesses with independent talent around the globe. We serve everyone from one-person startups to 30% of the Fortune 100 with a powerful, trust-driven platform that enables companies and freelancers to work together in new ways that unlock their potential.

Why Work With Us

Our vibrant culture is built on a common mission to create economic opportunities so that people have better lives. We encourage team Upwork to bring their whole selves to work through learning and development opportunities, mentorship, and Upwork Belonging Communities.

Gallery

Gallery

Similar Jobs

TransUnion Logo TransUnion

Account Executive

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Remote or Hybrid
Ontario, ON, CAN
13000 Employees

Opendoor Logo Opendoor

Senior Manager, Marketing Operations & Automation

eCommerce • Fintech • Real Estate • Software • PropTech
Hybrid
Ontario, ON, CAN
1600 Employees
129K-177K Annually

MongoDB Logo MongoDB

Staff Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Hybrid
6 Locations
5550 Employees
159K-221K Annually

Gusto Logo Gusto

Staff Software Engineer

Fintech • HR Tech
Easy Apply
Remote or Hybrid
6 Locations
4405 Employees
200K-270K Annually

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account