Agentic AI Engineer

Posted 11 Days Ago
New York, NY, USA
In-Office
107K-215K Annually
Senior level
Software • Sports • Wearables • Analytics
The Role
Design and ship reliable production agentic AI systems for sports performance. Build multi-agent orchestration, persistent memory, tool use, confidence calibration, human-in-the-loop escalation, evaluation harnesses, observability, and regression testing. Collaborate with sport scientists and domain experts to create grounded, traceable, actionable recommendations that appropriately defer to humans. Requires strong Python, software engineering, production operations, and hands-on experience with agentic AI, multi-agent systems, and probabilistic model calibration.
Summary Generated by Built In

Catapult is building the future of sports performance technology.

Since 2006, we’ve helped more than 5,000 teams use data, science and technology to improve athlete health, readiness and performance. Our customers include teams across the NFL, NBA, NHL, MLS, EPL, AFL, NRL, NCAA and many more.

Now we're building the next layer of that platform: AI that can reason across everything we know about an athlete and turn it into intelligence a coach or performance practitioner can trust.

We're looking for an Agentic AI Engineer who has already shipped production AI systems and understands what it takes to make them reliable, measurable and trustworthy.


What you'll do:

  • Design and ship specialist AI agents that use memory, tools, data and multi-step reasoning.
  • Build multi-agent orchestration that routes work between specialist agents, manages dependencies and synthesises conflicting outputs.
  • Develop systems that evaluate confidence, uncertainty and consequence before recommendations reach a practitioner.
  • Build human-in-the-loop escalation so the system knows when to answer, when to ask for more information and when to defer to a human.
  • Create workflows that turn sport scientist expertise into validated, versioned and testable agent capabilities.
  • Build evaluation, observability and regression testing so agent performance can be measured and improved in production.
  • Work with domain experts to ensure AI outputs are grounded, traceable and actionable.

The goal is simple: multiple specialist agents working together to answer complex performance questions with a recommendation that is fast, grounded and calibrated.

What you need:

This is a senior engineering role. Three technical capabilities are essential.

1. Production agentic AI

You have personally shipped a production agentic AI system used by real users.

You have hands-on experience with:

  • Memory or persistent state
  • Tool use or tool calling
  • Multi-step reasoning or workflows
  • Production deployment and operation

Chatbots, prompt engineering and RAG alone are not enough.

2. Multi-agent orchestration

You have built or substantially contributed to a production multi-agent system.

You understand:

  • Agent routing and orchestration
  • Specialist agent composition
  • Dependency-aware workflows
  • Parallel and sequential execution
  • Conflicting agent outputs
  • Response synthesis

Experience with LangGraph, AutoGen, CrewAI or equivalent frameworks is valuable.

3. Confidence calibration

You have hands-on experience calibrating probabilistic ML or AI systems.

You should be comfortable with:

  • Platt scaling
  • Isotonic regression
  • Expected Calibration Error (ECE)
  • Reliability and calibration curves
  • Confidence and uncertainty estimation

We care about the difference between a model that sounds confident and a system with measurably calibrated confidence.


You should also have:

  • 5+ years of professional experience in applied ML, AI or software engineering
  • Strong Python
  • Strong software engineering fundamentals
  • Experience building and operating production systems

Experience with:

  • Production RAG and reranking
  • Foundation-model fine-tuning or domain adaptation
  • LoRA, PEFT or similar techniques
  • LLM observability and drift detection
  • Evaluation harnesses and automated regression testing
  • Human-in-the-loop architectures
  • Confidence thresholds and escalation models
  • Causal or counterfactual reasoning
  • Go/Golang
  • AWS, including ECS, EC2, Lambda, SNS or SQS
  • GraphQL, REST or gRPC
  • PostgreSQL or MongoDB

Experience working with sport scientists, clinicians or other domain experts is a plus.

You don't need to be a sports scientist, but familiarity with workload, readiness, recovery, biomechanics or athlete performance data will help.


What success looks like:

You'll help build a platform where specialist agents can investigate complex performance questions, use the right evidence, assess their uncertainty and produce a recommendation that a practitioner can understand and trust.

Most importantly, the system will know when not to answer.

Every recommendation should be:

Grounded. Calibrated. Traceable. Escalation-aware.

The practitioner remains responsible for the decision. Your job is to make that decision better informed, faster and more defensible.


Before you apply:

If you can demonstrate all three of the following, we'd like to hear from you:

  1. Production agentic AI
  2. Production multi-agent orchestration
  3. Hands-on confidence calibration

We don't expect every candidate to have every preferred skill. If you have the core experience and are excited by the problem, please apply.


Compensation & Benefits

The target Total Compensation range for this position is $107,250 - $214,500 per year. This range is inclusive of base salary and a target incentive plan (which may include equity, commission, or other bonus structures).

Your specific compensation within this range will be determined by factors such as your geographic location, relevant experience, and job-related skills.

In addition to this compensation, Catapult also offers generous paid leave and recognized company holidays, and the opportunity to participate in our comprehensive benefits package, including Health, Dental, and Vision insurance, and 401(k) retirement plan with company match.


Whether you’re interested in sports or not, you’ll have the satisfaction of knowing your work is supporting some of the most successful teams and athletes on the planet! 

Research shows that while men apply for jobs when they meet an average of 60% of the criteria, women and other marginalized groups tend only to apply when they check every box. So if you have what it takes, but don't meet every single point in our job ad, please still get in touch! We would love to have a chat and see if you could be a great addition to our team. We are building the future of sports performance. Our priority is to find the brightest talent who can add to our team culture, actively contribute, and be excited about what they do.


All offers of employment are subject to Catapult's positive prehire check. To find out more, please contact the Talent Partner for this role.

Skills Required

  • Personally shipped a production agentic AI system used by real users, including memory or persistent state, tool use, multi-step reasoning or workflows, and production deployment and operation.
  • Built or substantially contributed to a production multi-agent system with routing, orchestration, specialist composition, dependency-aware workflows, parallel and sequential execution, conflict resolution, and response synthesis.
  • Hands-on experience calibrating probabilistic ML or AI systems, including Platt scaling, isotonic regression, Expected Calibration Error, reliability curves, and uncertainty estimation.
  • Five or more years of professional experience in applied machine learning, artificial intelligence, or software engineering.
  • Strong Python skills.
  • Strong software engineering fundamentals.
  • Experience building and operating production systems.
  • Experience with LangGraph, AutoGen, CrewAI, or equivalent agentic AI frameworks.
  • Experience with production RAG and reranking.
  • Experience with foundation-model fine-tuning or domain adaptation.
  • Experience with LoRA, PEFT, or similar techniques.
  • Experience with LLM observability and drift detection.
  • Experience with evaluation harnesses and automated regression testing.
  • Experience with human-in-the-loop architectures, confidence thresholds, and escalation models.
  • Experience with causal or counterfactual reasoning.
  • Experience with Go or Golang.
  • Experience with AWS, including ECS, EC2, Lambda, SNS, or SQS.
  • Experience with GraphQL, REST, or gRPC.
  • Experience with PostgreSQL or MongoDB.
  • Experience working with sport scientists, clinicians, or other domain experts.
  • Familiarity with workload, readiness, recovery, biomechanics, or athlete performance data.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Melbourne
579 Employees
Year Founded: 2006

What We Do

Catapult exists to unleash the potential of every athlete and team on earth. Operating at the intersection of sports science and analytics, Catapult products are designed to optimize performance, avoid injury, and quantify return to play. Catapult has over 400 staff based across 24 locations worldwide, working with more than 3,200 elite teams in 137 countries globally. To learn more about Catapult and to inquire about accessing performance analytics for a team or athlete, visit us at catapultsports.com. Catapult Group International Limited (CAT) is listed on the Australian Stock Exchange.

Similar Jobs

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
197K-246K Annually

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
230K-286K Annually

New York Life Insurance Company Logo New York Life Insurance Company

Corporate Vice President - Release Train Engineer (RTE) - Agentic AI Web Application

Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
New York, NY, USA
12000 Employees
148K-211K Annually

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
230K-286K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account