Senior DevOps Engineer - GCP

Reposted 19 Days Ago
7 Locations
In-Office
168K-225K Annually
Senior level
Artificial Intelligence • Generative AI
The Role
The Senior DevOps Engineer will design and maintain infrastructure on GCP for AI workloads, focusing on security and performance, while collaborating with multiple teams.
Summary Generated by Built In

Job Title: Senior DevOps Engineer – GCP
Location: SF Bay Area
Type: Full-time
Team: Platform Engineering
Reports To: Head of Platform Engineering

About Us

WitnessAI is a fast-growing SaaS startup on a mission to enable enterprises to adopt AI, safely. We're building a product that provides security and governance guardrails for public and private LLMs.

About the Role

We’re looking for a Sr. DevOps Engineer who will take ownership of designing, securing, and scaling the cloud backbone of our AI security platform. You’ll be responsible for infrastructure architecture in Google Cloud Platform (GCP), with a deep focus on networking, VPC security, interconnectivity, and service reliability.

You’ll work closely with ML engineers, security researchers, and backend developers to build highly reliable, secure, and performant environments for running AI workloads and security tooling.

What You’ll Do
  • Design, implement, and maintain GCP-based infrastructure for secure AI workloads and APIs

  • Build and manage scalable, low latency Internet and Cloud networking strategies eg Anycast+, route optimization, and private VPC peering, VPC networks, private service access, peering, and firewall configurations.

  • Develop secure ingress/egress patterns, service meshes, and zero-trust networking topologies

  • Automate infrastructure provisioning using Terraform, Helm, and CI/CD workflows

  • Collaborate on platform observability: logging, monitoring, alerting, and incident response

  • Harden cloud infrastructure against threats using IAM best practices, organization policies, and GCP security controls

  • Work cross-functionally with engineering, data science, and security teams to optimize environment reliability and cost

  • Help establish infrastructure SLAs, SLOs, and runbooks as the platform scales

What We’re Looking For
  • 7+ years of experience in infrastructure engineering, site reliability, or DevOps

  • Deep expertise in Google Cloud Platform, including VPC networking, Cloud NAT, private services, and inter-project connectivity

  • Strong knowledge of Terraform and infrastructure-as-code practices

  • Proficiency with container orchestration (Kubernetes / GKE preferred)

  • Experience designing for high availability, scalability, and secure access across cloud environments

  • Familiarity with service mesh tools (Istio, Linkerd, etc.) and API gateways

  • Solid understanding of Linux, DNS, TLS, load balancing, and network security principles

  • Comfort working in a fast-paced startup environment with ownership and autonomy

  • Bonus: Experience in regulated or high-security environments (SOC 2, FedRAMP, HIPAA, etc.)

  • Bonus: Exposure to ML infrastructure, GPU workloads, or data pipelines, including VPC networking, Cloud NAT, private services, and inter-project connectivity

Benefits:

  • Hybrid work environment

  • Competitive salary, health, dental, and vision insurance

  • 401(k) plan

  • Opportunities for professional development and growth

  • Generous vacation policy

Salary range:

$168K-$225K (Bay Area)

Top Skills

Ci/Cd
Dns
Google Cloud Platform
Helm
Istio
Kubernetes
Linkerd
Linux
Terraform
Tls
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Mateo, CA
34 Employees
Year Founded: 2023

What We Do

WitnessAI is building the guardrails that make AI safe, productive, and usable. Our platform allows enterprises to innovate and enjoy the power of generative AI, without losing control, privacy, or security.

WitnessAI is a set of security microservices that can be deployed on premise in your environment, in a cloud sandbox, or your VPC, to ensure that your data and activity telemetry is separated from other customers. Unlike other AI governance solutions, WitnessAI provides regulatory segregation of your information.

#AIGovernance #EnterpriseAI #SecureAI #GenerativeAI #AICompliance #DataPrivacy

Similar Jobs

Snyk Logo Snyk

Account Director

Artificial Intelligence • Cloud • Information Technology • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
Canada
1000 Employees
140K-158K Annually

Snyk Logo Snyk

Account Director

Artificial Intelligence • Cloud • Information Technology • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
Canada
1000 Employees
140K-158K Annually

Block Logo Block

Site Reliability Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office
8 Locations
12000 Employees
185K-327K Annually

Block Logo Block

Account Executive

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office
8 Locations
12000 Employees
69K-139K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account