Senior Backend Engineer

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Senior level
Artificial Intelligence • Software
The Role
Design and build high-throughput backend services and APIs to ingest, evaluate, and serve agent telemetry at scale. Own API contracts and versioning, optimize ClickHouse OLAP schemas and queries for petabyte-scale reads, collaborate with platform/infra on reliability and scalability, and uphold high engineering quality.
Summary Generated by Built In
The Role

We're looking for a Senior Backend Engineer to own the services and APIs that power the data layer. You'll design the systems that ingest, evaluate, and serve agent telemetry at scale.

What You'll Do
  • Design and build high-throughput backend services that ingest and process hundreds of thousands of agent traces per second.

  • Own the API surface our SDKs and dashboards depend on: define contracts, manage versioning, and keep latency low under real customer load.

  • Tune our OLAP layer (ClickHouse) through schema design, query optimization, and access-pattern analysis so reads stay fast as data grows to petabyte scale.

  • Partner with the platform and infra teams on scalability, reliability, and the systems that back our evaluation and monitoring pipelines.

  • Advocate for a high bar on backend and engineering quality: reliable, efficient, well-documented, testable, and maintainable.

What We're Looking For
  • 6+ years of relevant industry experience building and operating high-throughput backend systems and services.

  • Strong fundamentals in API design, data modeling, and the trade-offs of distributed systems under real production load.

  • Hands-on experience with OLAP / columnar databases (ClickHouse, Presto) and a feel for how query patterns map to storage internals.

  • Experience designing high-performance distributed systems.

  • Comfort across the stack, with the breadth to reason about platform and infra decisions.

  • Strong communication skills. You write clearly, review well, and make the people around you better.

Nice to Have
  • Experience scaling pipelines that fan out to LLM APIs and managing the rate-limit, retry, and cost dynamics that come with them.

  • Familiarity with streaming systems (Kafka, Spark, Flink, Ray) and ML orchestration tools (Airflow, Dagster, Prefect).

  • Background in embedding / vector search infrastructure or data quality monitoring.

  • Prior work on observability or developer-facing platform products.

Skills Required

  • 6+ years building and operating high-throughput backend systems and services
  • Strong fundamentals in API design, data modeling, and distributed systems trade-offs
  • Hands-on experience with OLAP / columnar databases (ClickHouse, Presto)
  • Experience designing high-performance distributed systems
  • Comfort across the stack to reason about platform and infra decisions
  • Strong written and verbal communication skills
  • Experience scaling pipelines that fan out to LLM APIs (rate-limit, retry, cost dynamics)
  • Familiarity with streaming systems (Kafka, Spark, Flink, Ray)
  • Familiarity with ML orchestration tools (Airflow, Dagster, Prefect)
  • Background in embedding / vector search infrastructure or data quality monitoring
  • Prior work on observability or developer-facing platform products
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
20 Employees
Year Founded: 2025

What We Do

Judgment Labs builds agent behavior monitoring (ABM) infrastructure. Judgment provides a toolkit to track and judge agent behavior in online and offline setups, enabling you to convert high-signal interaction data from production/test environments into more reliable agents.

Similar Jobs

Airwallex Logo Airwallex

Senior Back-end Engineer

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
San Francisco, CA, USA
2200 Employees
150K-245K Annually

SoFi Logo SoFi

Senior Back-end Engineer

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
San Francisco, CA, USA
4500 Employees
188K-206K Annually

Comcast Logo Comcast

Senior Back-end Engineer

Digital Media • Information Technology • News + Entertainment
Hybrid
Irvine, CA, USA
11500 Employees
142K-189K Annually

Product.ai Logo Product.ai

Senior Back-end Engineer

Artificial Intelligence • Big Data • Consumer Web • eCommerce
Hybrid
Los Angeles, CA, USA
25 Employees
280K-500K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account