Jobs at Judgment Labs

Build end-to-end product and agent systems that ingest production agent traces, run large-scale investigations, verify agent changes via simulated envs and trajectory replay, design investigator and swarm UX, and build platform features (workspaces, roles, billing, SDKs) to close the improvement loop for AI agents.

Design and build high-throughput backend services and APIs to ingest, evaluate, and serve agent telemetry at scale. Own API contracts and versioning, optimize ClickHouse OLAP schemas and queries for petabyte-scale reads, collaborate with platform/infra on reliability and scalability, and uphold high engineering quality.

Embed Judgment Labs' agent behavior monitoring into customer production systems: integrate monitoring and evaluation into agent workflows, diagnose failures in live environments, guide customers on monitoring and evaluation strategy, and own multiple customer engagements end-to-end to ensure sustained adoption.

Design, build, and operate multi-region, highly available cloud and self-hosted/BYOC deployment architectures across AWS, GCP, and Azure. Implement secure networking, compliance/data residency solutions, automated provisioning, and observability for distributed customer environments. Own infrastructure roadmap, reliability, and enterprise deployment lifecycle, including documentation and customer-facing implementation guides.

Build scalable systems to aggregate, index, and analyze large-scale agent interaction data; develop agent-based evaluation systems; design post-training and optimization workflows; build internal tools and infrastructure for experimentation, analysis, and training; ship research into production and collaborate cross-functionally to improve agent behavior.