Senior Software Engineer - Infrastructure

Reposted 23 Days Ago
San Francisco, CA
In-Office
160K-200K Annually
Mid level
Artificial Intelligence • Software
The Role
Design and operate a secure, multi-tenant container infrastructure, manage deployments in cloud/on-prem environments, and drive observability and optimization efforts.
Summary Generated by Built In

Compensation: Competitive base salary + meaningful equity
Benefits: Health & dental, gym reimbursement, daily team lunches, 401(K)

About Julius

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in isolated remote containers that we manage. We’re revenue‑generating and backed by AI Grant and founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution platform that powers Julius—across cloud and on‑prem environments. We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do
  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship on‑prem/private cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost; build fair‑use and rate‑limiting controls.

What You Bring
  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have
  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • Delivered on‑prem or air‑gapped enterprise software.

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Top Skills

AWS
Azure
Cilium
Containerd
Docker
Ebpf
Elk
Firecracker
GCP
Grafana
Gvisor
Helm
Karpenter
Kata
Keda
Knative
Kubernetes
Opentelemetry
Prometheus
Terraform
Vector
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
12 Employees

What We Do

Your AI Data Scientist: Easily analyze, visualize and transform data

Similar Jobs

Anduril Logo Anduril

Senior Software Engineer

Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
In-Office
Costa Mesa, CA, USA
6000 Employees
191K-253K Annually

Nuro Logo Nuro

Senior Software Engineer

Artificial Intelligence • Automotive • Information Technology • Robotics
In-Office
Mountain View, CA, USA
908 Employees
160K-241K Annually

General Motors Logo General Motors

Senior Software Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Hybrid
4 Locations
165000 Employees

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
5 Locations
21960 Employees
184K-357K Annually

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account