Machine Learning Engineer - Inference / Serving

Posted 10 Days Ago
2 Locations
In-Office or Remote
Mid level
Artificial Intelligence • Software • Database
The Role
As a Machine Learning Engineer at Yobi, you will design and optimize systems for real-time model serving and inference, ensuring performance and reliability.
Summary Generated by Built In

Yobi is a rapidly growing Behavioral AI company on a mission to ethically democratize the benefits of data and AI.

Since 2019, we have built one of the largest consented behavioral datasets in the United States, extending far beyond the walled gardens of Big Tech. Unlike traditional LLM companies, Yobi builds foundation models of human behavior grounded in real-world actions such as purchases and store visits.

Our private-by-design modeling enables state-of-the-art personalization and decisioning for leading brands and agencies while protecting privacy, safety, and ethics.

Today, we are focused on bringing the performance of closed-web user acquisition to the open web and connected TV, giving brands walled-garden results without the walls.

At our core, Yobi is building the behavioral intelligence layer for any system that makes a personalization decision.

Working at Yobi

We’re at an inflection point—customer adoption is accelerating, but there’s still room to shape the architecture and culture from the ground up. Engineers here own major surface areas, build 0→1 systems in large-scale data and model infrastructure, and help define how Behavioral AI scales ethically and effectively.

Highlights:

  • Well-funded with 5+ years of runway. At the same time, we are scaling revenue quickly and project to be breakeven in 2026.

  • Partnerships with Microsoft and Databricks

  • Fully remote or hybrid from several hubs (SF Bay Area, Seattle, NYC)

  • World-class team of Machine Learning experts who worked on cutting edge infra and recommender systems @ Amazon, Uber, Twitter, Meta, etc.

  • Product and Go-To-Market teams who have taken ideas from concept to 9 figure revenue streams

Benefits:

  • Competitive Base Salary

  • Meaningful equity & financial upside - a real % of the company

  • Annual bonus target based on personal and company performance

  • Health, Dental, Vision - most plans will pay little to 0 out of pocket

  • Unlimited PTO - we care about impact, not tracking days you’re out

  • 401k with company match %

About The Role

As a Machine Learning Engineer focused on Inference and Serving at Yobi, you’ll design, optimize, and operate the systems that bring our Behavioral AI models to life in real time. You’ll work at the core of our production environment, turning trained models into performant, reliable, and continuously improving services that power our open-web and CTV products.

This is an applied ML systems role—equal parts engineering depth, deployment craft, and model intuition. You’ll shape how models are packaged, versioned, rolled out, and observed across environments, ensuring every prediction is fast, accurate, and accountable.

What it takes to succeed in this role:
  • Deep expertise in model deployment. You’ve built or scaled production ML serving systems—handling versioning, rollouts, rollback strategies, and live experimentation.

  • Low-latency mindset. You understand what makes inference fast: model graph optimization, quantization, caching, batching, and efficient feature retrieval.

  • Systems fluency. You write robust, high-performance code in Go, Rust, C++, or Java, and are comfortable bridging to Python for model integration and analysis.

  • Operational maturity. You treat inference as a living system—monitoring drift, tracking model lineage, and ensuring observability from input to outcome.

  • Infrastructure intuition. You know how to make serving systems reproducible and portable without over-engineering them, whether that’s through custom runtime design, model registries, or lightweight orchestration.

  • Applied ML understanding. You can reason about model performance, interpret trade-offs, and work with researchers to make models more deployable.

We prioritize attitude, culture, and general (technical) fit over matching perfectly into one of our job descriptions. If our mission and work resonates with you, we encourage you to apply. Tell us how you can help drive our products forward, even if you don’t feel like you are a perfect fit for some of the listings. 

Top Skills

C++
Go
Java
Python
Rust
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
16 Employees
Year Founded: 2019

What We Do

Since Yobi’s founding in 2019, we’ve been focused on solving the single biggest challenge to democratized AI for organizations of all sizes: ACCESS TO DATA.

Today’s Large Language Model’s lack a defensible moat because they’re trained on public data, like Reddit, WordPress, and other public web sites. Unfortunately, unless you’re Google or Amazon, your 1P data estate doesn’t provide a holistic consumer view to deliver real impact.

Yobi partnered with Microsoft to assemble one of the largest consented behavioral datasets to underpin a private foundation model of behavioral intelligence without sacrificing consumer choice or privacy.

For data scientists, this foundation model can be fine-tuned and joined to customer 1P data to ignite model training and performance.

For marketers, this big-tech like behavioral model can be plugged into open web activation and personalization platforms to unlock new levels of audience targeting and consumer experiences beyond the walled gardens.

Together, through collaboration, WE CAN DEMOCRATIZE THE AI REVOLUTION.

Similar Jobs

In-Office or Remote
New York, NY, USA
200 Employees
65K-72K Annually
Easy Apply
Remote or Hybrid
USA
255 Employees
182K-236K Annually

Addition Wealth Logo Addition Wealth

Senior Data Engineer

Fintech • HR Tech • Financial Services
Easy Apply
Remote
United States
50 Employees
150K-185K Annually

Gusto Logo Gusto

Account Executive

Fintech • HR Tech
Easy Apply
Remote or Hybrid
4 Locations
4405 Employees
158K-265K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account