Staff Machine Learning Engineer

Posted Yesterday
Be an Early Applicant
Santa Clara, CA, USA
Hybrid
176K-308K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
We're putting AI to work for people.
The Role
Design and lead production agentic AI systems for CPQ, including multi-agent orchestration, custom async runtimes, streaming, MCP and A2A interoperability, RAG, and context engineering. Make architecture decisions across state management, tool boundaries, latency, cost, and multi-tenant deployment. Contribute across Python, Java/Spring Boot, and React/TypeScript systems, evaluate classical ML alternatives, set technical direction, and work directly with customers and product teams.
Summary Generated by Built In
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

Team Overview

We build the AI layer of our CPQ platform — a set of Python services that let users configure, quote, and manage transactions through natural language instead of forms. This isn't a thin LLM wrapper. We're running multiple production agent architectures concurrently (ReAct-style tool-calling agents, hand-rolled LangGraph state machines, and the Harness — our from-scratch, industry-leading agent execution runtime). Our systems are backed by a first-party MCP surface into admin/product/rules/transaction systems and interoperate with other AI agents over the A2A protocol. Below that sits a conventional Java/Spring Boot microservices fleet and a React/TypeScript + Lit frontend that the agents ultimately drive.

Role Overview

We're looking for someone who already operates at a Senior-Staff bar in the agentic/LLM domain but is building out breadth across the rest of the stack. You'll be one of the most senior technical voices on how agentic systems get designed here — state management, tool boundaries, streaming protocols, prompt/context architecture, and multi-agent coordination — while staying credible end-to-end: able to read a Spring Boot service, unblock a frontend integration, or reason about a classical ML model pipeline when the problem calls for it.

What you get in this role:

  • Multi-agent orchestration — LangGraph/LangChain agents over frontier LLMs for transaction editing, conversational configuration, and multi-product quote planning with plan/approve/refine loops and parallel task execution
  • The Harness — we're crystallizing our own agent execution runtime into an industry-leading, state-of-the-art harness. Full-duplex sessions where a user can interrupt, redirect, or answer a clarifying question mid-execution while other work keeps streaming, built on a from-scratch async runtime rather than a bolted-on wrapper around someone else's agent loop. This is as much a performance and UX problem as a backend one — low-latency streaming, backpressure, live progress, partial results, graceful cancellation — and it's the part of the stack we're most invested in owning outright. You'd be a primary owner of where this goes next.
  • MCP as a secondary interface — we maintain a first-party MCP server and clients into our admin/product/rules/transaction systems, but as the Harness matures it becomes the primary way our own agents interact with the platform, with MCP kept as the secondary, standards-based surface for external interop. You'd help decide what stays MCP-first and what moves onto the Harness.
  • A2A protocol — agent-to-agent task delegation and streaming, surfaced through an external gateway so other systems (including core ServiceNow) can drive our agents directly
  • Forward Deployed Engineering — expect real time embedded with customer- and product-facing teams against live deployments. Adapting the Harness and our agents to actual customer workflows under real constraints, not just building platform capability in the abstract
  • RAG / context engineering — tenant-uploaded document ingestion, categorization, and aggregation into agent context. Prefix-cacheable prompt design for cost/latency
  • Classical ML, when the problem isn't a good fit for an LLM — we have a separate PyTorch/scikit-learn training and serving pipeline (field-value prediction) that a whole-stack ML engineer should be able to read, extend, or evaluate against LLM-based alternatives
  • Full-stack fluency — enough comfort in Spring Boot/Java services and the React/TypeScript + Lit frontend to unblock an integration end-to-end without waiting on a handoff

Qualifications

To be successful in this role you have:

  • 8+ years building production software, with several years specifically shipping LLM-powered / agentic systems (not just API wrapper calls — real tool-use loops, state management, multi-turn orchestration)
  • Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. This may include using AI-powered tools, automating workflows, analyzing AI-driven insights, or exploring AI's potential impact on the function or industry.
  • Deep, hands-on expertise with LangGraph and/or LangChain (or the judgment to know when to skip them and hand-roll something better)
  • Strong understanding of MCP — ideally having built an MCP server, not just consumed one
  • Production async Python (FastAPI, asyncio) — comfortable with WebSockets, streaming, and the failure modes of long-lived stateful connections
  • Track record of making real architecture decisions on agent systems — tool boundaries, context/state design, cost/latency tradeoffs, when a bounded agent beats a fully autonomous one
  • Enough range outside Python to read/modify a Spring Boot service and a React component without hand-holding — this is explicitly a whole-stack role, not "Python specialist with a frontend allergy"
  • Comfort operating with ambiguity and setting technical direction, not just executing a spec — this is a Staff-level bar on judgment
  • A demonstrated habit of pulling the latest from the industry — new agent frameworks, protocol standards, model capabilities — into production quickly
  • Willingness and ability to build real fluency in the Core ServiceNow platform. Our systems increasingly need to interoperate with it directly, and this role is expected to help drive that, not just react to it
  • Willingness to work directly with customers/deployments as part of Forward Deployed Engineering efforts — this isn't a purely internal-platform role

Desired Qualifications

  • Experience with classical ML (PyTorch/scikit-learn) in addition to LLM-based systems
  • Experience with A2A or other agent-to-agent interop protocols
  • Experience with RAG / knowledge-graph systems (embeddings, vector or graph-based retrieval)
  • Multi-tenant SaaS experience, especially around per-tenant isolation of stateful connections/resources
  • CPQ, quoting, or transaction/pricing domain experience
  • Prior Forward Deployed Engineering experience, or time spent embedded with customers shipping bespoke solutions exposure

 

For positions in this location, we offer a base pay of $176,100 - $308,200, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Skills Required

  • 8+ years building production software, including several years shipping LLM-powered or agentic systems
  • Experience integrating AI into work processes, decision-making, or problem-solving
  • Deep hands-on expertise with LangGraph and/or LangChain, or ability to determine when to hand-roll an alternative
  • Strong understanding of MCP, ideally including building an MCP server
  • Production asynchronous Python experience with FastAPI, asyncio, WebSockets, streaming, and long-lived stateful connections
  • Experience making architecture decisions for agent systems, including tool boundaries, context and state design, cost, latency, and autonomy tradeoffs
  • Ability to read and modify Spring Boot services and React components
  • Staff-level judgment operating with ambiguity and setting technical direction
  • Habit of bringing emerging agent frameworks, protocol standards, and model capabilities into production
  • Willingness and ability to build fluency in the Core ServiceNow platform
  • Willingness and ability to work directly with customers and deployments
  • Classical ML experience with PyTorch or scikit-learn
  • Experience with A2A or other agent-to-agent interoperability protocols
  • Experience with RAG or knowledge-graph systems, embeddings, and vector or graph-based retrieval
  • Multi-tenant SaaS experience, especially tenant isolation of stateful connections and resources
  • CPQ, quoting, or transaction/pricing domain experience
  • Prior Forward Deployed Engineering experience or experience embedded with customers shipping bespoke solutions

What the Team is Saying

Shanequa
Katya
Suzanne
Alexander
Jaime
Pat
Brady
Hasan
Jamil
Viviana

ServiceNow Compensation & Benefits Highlights

  • Healthcare Strength Healthcare is described as comprehensive, with employer‑verified medical, dental, vision, life and disability coverage plus mental‑health support. Feedback suggests plan breadth and quality are a standout element of the package.
  • Leave & Time Off Breadth Time off options include flexible PTO, paid holidays, paid volunteer time, and additional company “Wellbeing Days.” Feedback suggests employees value the breadth of recharge time available.
  • Equity Value & Accessibility Ownership programs feature a 15%‑discount Employee Stock Purchase Plan alongside role‑based equity (e.g., RSUs) and performance bonuses. Feedback suggests these elements meaningfully lift total compensation beyond base pay.

ServiceNow Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
29,000 Employees
Year Founded: 2004

What We Do

As the AI platform for business transformation, we're putting AI to work across organizations — freeing people for work that matters. Making old tech work with new tech. Reaching across departments, from the front office to the back office and every office in between. Our ambition? To become the AI defining enterprise software company of the 21st century (or "AI DESCO21C," as we like to call it). With more than 8,400+ customers, we serve approximately 90% of the Fortune 500®, and we're proud to be a Fortune 100 Best Companies to Work For® and World's Most Admired Companies™. Explore your future career with us, visit www.careers.servicenow.com From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Why Work With Us

By joining ServiceNow, you are part of an ambitious team of change-makers who have a restless curiosity and a drive for ingenuity. We're committed to helping our people do their best work and live their best lives so we can fulfill our purpose together. At the fastest-growing enterprise software company, you can grow your career faster.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

ServiceNow Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

At ServiceNow, we lead with flexibility and trust. For some, home is the primary workplace. For those who come into a ServiceNow workplace, you are empowered to make team-guided and individual-led decisions on how and when you use the workplace.

Typical time on-site: Flexible
Company Office Image
HQSanta Clara, CA
Heredia
Ciudad de México
District of Columbia
Osaka
Aarhus, DK
Aarhus, DK
Company Office Image
Addison, TX
Amsterdam, North Holland
Atlanta, Georgia
Auckland, Auckland
Bangkok, Bangkok
Bengaluru, Karnataka
Bengaluru, Karnataka
Berlin, Berlin
Brasília, Federal District
Brisbane, Queensland
Brussels, BE
Cairo, Cairo Governorate
Canberra, Australian Capital Territory
Charlottesville, Virginia
Company Office Image
Chicago, IL
Deerfield, Illinois
Company Office Image
Denver, CO
Dubai, Dubai
Dublin, Leinster
Düsseldorf, Nordrhein-Westfalen
Frankfurt am Main, Hesse
Goteborg, Västra Götaland County
Gurugram, Haryana
Hamburg, Hamburg
Hanyang, Seoul
Helsinki, Uusimaa
Hong Kong, Hong Kong
Houston, TX
Hyderabad, Telangana
Issy-les-Moulineaux, Île-de-France
Johannesburg, Gauteng
Kirkland, WA
Lausanne, Vaud
Lille, Hauts de France
London, England
London, England
Madrid, Community of Madrid
Melbourne, Victoria
Milano, Lombardia
Milwaukee, WI
Company Office Image
Montréal, QC
Mumbai, Maharashtra
Munich, Bavaria
Company Office Image
New York, NY
Opfikon, Zürich
Orlando, FL
Oslo, Oslo
Perth, Western Australia
Petah Tikva, Central District
Company Office Image
Pleasanton, CA
Riyadh, Riyadh Province
Rome, Lazio
Company Office Image
San Diego, CA
San Francisco, Heredia
Company Office Image
San Francisco, CA
São Paulo, SP
Singapore, SG
Solna, Stockholm County
Sydney, New South Wales
Tokyo, Tokyo
Toronto, Ontario
Vancouver, British Columbia
Company Office Image
Vienna, VA
Vienna, AT
Company Office Image
Waltham, MA
Washington, DC
Wellington, Wellington
West Palm Beach, Florida
Learn more

Similar Jobs

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
176K-308K Annually

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
201K-352K Annually

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
29000 Employees

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
29000 Employees
176K-308K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account