Senior Cloud Infrastructure Engineer

Reposted 24 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Senior level
Artificial Intelligence • Software
The Role
Design, build, and operate multi-region, highly available cloud and self-hosted/BYOC deployment architectures across AWS, GCP, and Azure. Implement secure networking, compliance/data residency solutions, automated provisioning, and observability for distributed customer environments. Own infrastructure roadmap, reliability, and enterprise deployment lifecycle, including documentation and customer-facing implementation guides.
Summary Generated by Built In

Judgment Labs builds infrastructure for Agent Behavior Monitoring (ABM). While traditional observability focuses on logging exceptions and latency, our ABM surfaces behavioral anomalies such as instruction drifts and context retrieval loss in scaled production environments.
Hundreds of teams building autonomous agents rely on Judgment to understand how their systems are behaving post-deployment. Instead of reactive incident triage, they cluster patterns across conversations and workflows, correlate regressions to specific interaction types, and pinpoint where reliability breaks down in their usage context.
We’ve raised $30M+ across two rounds in the past five months. Our investors include Lightspeed, SV Angel, Valor Equity Partners, Nova Global, Chris Manning, Michael Ovitz, Michael Abbott, Cory Levy, Kevin Hartz, and others.
The Role:
We are looking for a Senior Cloud Infrastructure Engineer to architect and scale the deployment infrastructure that powers agent behavior monitoring at production scale. This role is crucial for enabling enterprise customers to run Judgment in their environments—whether that's multi-region cloud, self-hosted, or BYOC deployments—while maintaining the security, compliance, and reliability standards they require. We need someone who has built distributed systems that handle real production traffic and can own infrastructure from architecture through operations.
What You'll Do:
• Design and implement multi-region cloud architecture with automatic failover and disaster recovery across AWS, GCP, and Azure.
• Architect and deploy regional compliance solutions (data residency, sovereignty) for enterprise customers in different geographies.
• Design and implement self-hosted and BYOC (Bring Your Own Cloud) deployment architectures for enterprise customers with strict security requirements.
Build secure VPC peering and private connectivity solutions for customer-managed environments
Develop automated provisioning systems for on-premises and hybrid cloud deployments
Create customer-facing documentation and deployment guides for self-service infrastructure setup
• Design enterprise-grade security architectures including network isolation, encryption at rest and in transit, and identity management integration (SSO, SAML, SCIM).
• Build monitoring and observability solutions for distributed self-hosted deployments with centralized logging and alerting.
What We're Looking For:

  • 6+ years of experience designing and operating large-scale distributed systems in production.

  • Proven track record building infrastructure that supports mission-critical workloads with strict reliability guarantees.

  • Strong programming ability in at least one modern language (Go, Python, Typescript, Java, etc) with experience building production infrastructure systems.

  • Experience designing systems that handle high-throughput data pipelines, large-scale telemetry, or real-time services.

  • Deep understanding of failure modes in distributed systems and how to design resilient architectures.

  • Experience owning infrastructure systems from architecture through deployment and operations.

  • Ability to design infrastructure that remains operational under partial failures, degraded networks, and regional outages.

  • Strong experience writing technical design documents, architecture proposals, and operational runbooks.

Nice to have:

  • Experience with infrastructure patterns commonly used by companies like Datadog, Sentry, or Honeycomb:

    • operating large-scale telemetry ingestion pipelines

    • building high-throughput observability infrastructure

    • processing billions of events per day

  • Additional valuable experience:

    • private connectivity solutions (AWS PrivateLink, Azure Private Link, GCP Private Service Connect)

    • air-gapped or restricted network deployments

    • high-throughput streaming systems such as Kafka or RabbitMQ

    • multi-tenant SaaS infrastructure architectures

    • infrastructure supporting AI systems

Why Judgment?
Agents can’t work without this. Today’s agents hallucinate, drift, and break in production. We’re building the infrastructure that fixes this: the monitoring layer that makes agents self-improving.
We’re wired to win. We're a team of less than 20 but we ship like 50+ on the daily. You'll be working with olympiad medalists, debate champions, and competitive athletes who bring that same intensity to company building.
Fast track to founding. Our engineers interface directly with customers, ship code into their environments, and use their feedback to dictate what’s next on the roadmap. Everyone on the team is either an ex-founder or a founder-to-be.
We make sure our people do their best work. If you deserve a spot on the team, money will never get in the way of it. Full benefits, Equinox, and a private chef to take care of you. We sprint hard but we play hard, ask us about our Smash/Mario Kart tournaments.
We work in person in San Francisco.

Skills Required

  • Deep expertise across AWS, GCP, and Azure (compute, networking, storage, managed services)
  • Experience designing and operating multi-region, highly available cloud infrastructure with automatic failover and disaster recovery
  • Strong knowledge of cloud networking including VPCs, load balancers, DNS, CDN, and service mesh
  • Expertise in Infrastructure as Code (Terraform, Pulumi, CloudFormation) and GitOps practices
  • Experience with self-hosted deployments, BYOC architectures, and customer environment lifecycle management
  • Experience building secure VPC peering and private connectivity solutions for customer-managed environments
  • Ability to develop automated provisioning systems for on-premises and hybrid cloud deployments
  • Design and implement enterprise-grade security architectures (network isolation, encryption in transit and at rest, identity integration SSO/SAML/SCIM)
  • Build monitoring and observability solutions with centralized logging and alerting for distributed/self-hosted deployments
  • Proven experience owning infrastructure architecture, roadmap, and operational reliability in production
  • Work in person in San Francisco
  • Experience with air-gapped and restricted network environments
  • Knowledge of private connectivity services (AWS PrivateLink, Azure Private Link, GCP Private Service Connect)
  • Familiarity with enterprise security and compliance frameworks (SOC 2, ISO 27001, HIPAA, FedRAMP)
  • Background from observability, Enterprise AI, or Infrastructure SaaS companies (Datadog, Sentry, Honeycomb, Databricks, Snowflake, Harvey, Glean)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
20 Employees
Year Founded: 2025

What We Do

Judgment Labs builds agent behavior monitoring (ABM) infrastructure. Judgment provides a toolkit to track and judge agent behavior in online and offline setups, enabling you to convert high-signal interaction data from production/test environments into more reliable agents.

Similar Jobs

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
3 Locations
21960 Employees
184K-357K Annually

Zoo (zoo.dev) Logo Zoo (zoo.dev)

Senior Software Engineer

Hardware • Software • Design
In-Office or Remote
Los Angeles, CA, USA
189 Employees
145K-195K Annually

PayPal Logo PayPal

Senior Software Engineer

Fintech • Payments
In-Office
4 Locations
34450 Employees
124K-213K Annually

PayPal Logo PayPal

Staff Software Engineer

Fintech • Payments
In-Office
3 Locations
34450 Employees
170K-292K Annually

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account