Software Engineer - Infrastructure (Mid - Senior)

Posted 8 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
150K-200K Annually
Mid level
Artificial Intelligence • Software
The Role
Build and scale secure, multi-tenant container infrastructure for cloud environments, ensuring reliability, performance, and security. Responsibilities include deploying cloud services, driving observability, and optimizing resource usage.
Summary Generated by Built In

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
12 Employees

What We Do

Your AI Data Scientist: Easily analyze, visualize and transform data

Similar Jobs

Vercel Logo Vercel

Legal Counsel

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
San Francisco, CA, USA
310K-340K Annually

Tempus AI Logo Tempus AI

Manager, Biostatistics

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Remote or Hybrid
4 Locations
3775 Employees

ServiceNow Logo ServiceNow

Creative Director

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
166K-290K Annually

ServiceNow Logo ServiceNow

Creative Director

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
114K-156K Annually

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account