Senior DevOps Engineer - GCP

Posted 8 Days Ago
7 Locations
In-Office
168K-225K
Senior level
Artificial Intelligence • Generative AI
The Role
The Senior DevOps Engineer will design and maintain infrastructure on GCP for AI workloads, focusing on security and performance, while collaborating with multiple teams.
Summary Generated by Built In

Job Title: Senior DevOps Engineer – GCP
Location: SF Bay Area
Type: Full-time
Team: Platform Engineering
Reports To: Head of Platform Engineering

About Us

WitnessAI is a fast-growing SaaS startup on a mission to enable enterprises to adopt AI, safely. We're building a product that provides security and governance guardrails for public and private LLMs.

About the Role

We’re looking for a Sr. DevOps Engineer who will take ownership of designing, securing, and scaling the cloud backbone of our AI security platform. You’ll be responsible for infrastructure architecture in Google Cloud Platform (GCP), with a deep focus on networking, VPC security, interconnectivity, and service reliability.

You’ll work closely with ML engineers, security researchers, and backend developers to build highly reliable, secure, and performant environments for running AI workloads and security tooling.

What You’ll Do
  • Design, implement, and maintain GCP-based infrastructure for secure AI workloads and APIs

  • Build and manage scalable, low latency Internet and Cloud networking strategies eg Anycast+, route optimization, and private VPC peering, VPC networks, private service access, peering, and firewall configurations.

  • Develop secure ingress/egress patterns, service meshes, and zero-trust networking topologies

  • Automate infrastructure provisioning using Terraform, Helm, and CI/CD workflows

  • Collaborate on platform observability: logging, monitoring, alerting, and incident response

  • Harden cloud infrastructure against threats using IAM best practices, organization policies, and GCP security controls

  • Work cross-functionally with engineering, data science, and security teams to optimize environment reliability and cost

  • Help establish infrastructure SLAs, SLOs, and runbooks as the platform scales

What We’re Looking For
  • 7+ years of experience in infrastructure engineering, site reliability, or DevOps

  • Deep expertise in Google Cloud Platform, including VPC networking, Cloud NAT, private services, and inter-project connectivity

  • Strong knowledge of Terraform and infrastructure-as-code practices

  • Proficiency with container orchestration (Kubernetes / GKE preferred)

  • Experience designing for high availability, scalability, and secure access across cloud environments

  • Familiarity with service mesh tools (Istio, Linkerd, etc.) and API gateways

  • Solid understanding of Linux, DNS, TLS, load balancing, and network security principles

  • Comfort working in a fast-paced startup environment with ownership and autonomy

  • Bonus: Experience in regulated or high-security environments (SOC 2, FedRAMP, HIPAA, etc.)

  • Bonus: Exposure to ML infrastructure, GPU workloads, or data pipelines, including VPC networking, Cloud NAT, private services, and inter-project connectivity

Benefits:

  • Hybrid work environment

  • Competitive salary, health, dental, and vision insurance

  • 401(k) plan

  • Opportunities for professional development and growth

  • Generous vacation policy

Salary range:

$168K-$225K (Bay Area)

Top Skills

Ci/Cd
Dns
Google Cloud Platform
Helm
Istio
Kubernetes
Linkerd
Linux
Terraform
Tls
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Mateo, CA
34 Employees
Year Founded: 2023

What We Do

WitnessAI is building the guardrails that make AI safe, productive, and usable. Our platform allows enterprises to innovate and enjoy the power of generative AI, without losing control, privacy, or security.

WitnessAI is a set of security microservices that can be deployed on premise in your environment, in a cloud sandbox, or your VPC, to ensure that your data and activity telemetry is separated from other customers. Unlike other AI governance solutions, WitnessAI provides regulatory segregation of your information.

#AIGovernance #EnterpriseAI #SecureAI #GenerativeAI #AICompliance #DataPrivacy

Similar Jobs

Square Logo Square

Data Scientist

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
139K-245K Annually

Square Logo Square

Staff Software Engineer

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
264K-395K Annually

Square Logo Square

Staff Software Engineer

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Hybrid
8 Locations
264K-395K Annually

McCain Foods Logo McCain Foods

Robotics Engineer

Food • Retail • Agriculture • Manufacturing
In-Office
Fredericton, NB, CAN
67K-90K Annually

Similar Companies Hiring

ClickMint Thumbnail
Marketing Tech • Generative AI • eCommerce • AdTech
Malibu, CA
7 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account