Senior DevOps Engineer - GCP

Reposted 17 Days Ago
7 Locations
In-Office
168K-225K Annually
Senior level
Artificial Intelligence • Generative AI
The Role
The Senior DevOps Engineer will design and maintain infrastructure on GCP for AI workloads, focusing on security and performance, while collaborating with multiple teams.
Summary Generated by Built In

Job Title: Senior DevOps Engineer – GCP
Location: SF Bay Area
Type: Full-time
Team: Platform Engineering
Reports To: Head of Platform Engineering

About Us

WitnessAI is a fast-growing SaaS startup on a mission to enable enterprises to adopt AI, safely. We're building a product that provides security and governance guardrails for public and private LLMs.

About the Role

We’re looking for a Sr. DevOps Engineer who will take ownership of designing, securing, and scaling the cloud backbone of our AI security platform. You’ll be responsible for infrastructure architecture in Google Cloud Platform (GCP), with a deep focus on networking, VPC security, interconnectivity, and service reliability.

You’ll work closely with ML engineers, security researchers, and backend developers to build highly reliable, secure, and performant environments for running AI workloads and security tooling.

What You’ll Do
  • Design, implement, and maintain GCP-based infrastructure for secure AI workloads and APIs

  • Build and manage scalable, low latency Internet and Cloud networking strategies eg Anycast+, route optimization, and private VPC peering, VPC networks, private service access, peering, and firewall configurations.

  • Develop secure ingress/egress patterns, service meshes, and zero-trust networking topologies

  • Automate infrastructure provisioning using Terraform, Helm, and CI/CD workflows

  • Collaborate on platform observability: logging, monitoring, alerting, and incident response

  • Harden cloud infrastructure against threats using IAM best practices, organization policies, and GCP security controls

  • Work cross-functionally with engineering, data science, and security teams to optimize environment reliability and cost

  • Help establish infrastructure SLAs, SLOs, and runbooks as the platform scales

What We’re Looking For
  • 7+ years of experience in infrastructure engineering, site reliability, or DevOps

  • Deep expertise in Google Cloud Platform, including VPC networking, Cloud NAT, private services, and inter-project connectivity

  • Strong knowledge of Terraform and infrastructure-as-code practices

  • Proficiency with container orchestration (Kubernetes / GKE preferred)

  • Experience designing for high availability, scalability, and secure access across cloud environments

  • Familiarity with service mesh tools (Istio, Linkerd, etc.) and API gateways

  • Solid understanding of Linux, DNS, TLS, load balancing, and network security principles

  • Comfort working in a fast-paced startup environment with ownership and autonomy

  • Bonus: Experience in regulated or high-security environments (SOC 2, FedRAMP, HIPAA, etc.)

  • Bonus: Exposure to ML infrastructure, GPU workloads, or data pipelines, including VPC networking, Cloud NAT, private services, and inter-project connectivity

Benefits:

  • Hybrid work environment

  • Competitive salary, health, dental, and vision insurance

  • 401(k) plan

  • Opportunities for professional development and growth

  • Generous vacation policy

Salary range:

$168K-$225K (Bay Area)

Top Skills

Ci/Cd
Dns
Google Cloud Platform
Helm
Istio
Kubernetes
Linkerd
Linux
Terraform
Tls
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Mateo, CA
34 Employees
Year Founded: 2023

What We Do

WitnessAI is building the guardrails that make AI safe, productive, and usable. Our platform allows enterprises to innovate and enjoy the power of generative AI, without losing control, privacy, or security.

WitnessAI is a set of security microservices that can be deployed on premise in your environment, in a cloud sandbox, or your VPC, to ensure that your data and activity telemetry is separated from other customers. Unlike other AI governance solutions, WitnessAI provides regulatory segregation of your information.

#AIGovernance #EnterpriseAI #SecureAI #GenerativeAI #AICompliance #DataPrivacy

Similar Jobs

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
143K-213K Annually

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
109K-166K Annually

Samsara Logo Samsara

Manager, Software Engineering - New Products

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CA
4000 Employees
150K-253K Annually

Samsara Logo Samsara

Senior Data Scientist

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
132K-171K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account