Sr. Staff Software Development Engineer - AI Platform

Posted 10 Hours Ago
Easy Apply
Be an Early Applicant
2 Locations
Remote or Hybrid
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Secure, simplify, and transform your enterprise with zero trust.
The Role
Design, scale, and maintain secure, highly available AWS infrastructure and platform capabilities for production AI/ML workloads. Build Terraform-based IaC, manage GitLab CI/CD pipelines, implement centralized observability with Prometheus/Grafana and alerting, drive DORA metrics, enable autoscaling/self-healing Kubernetes deployments, enforce platform governance and security best practices, and mentor engineering teams.
Summary Generated by Built In

About Zscaler

Zscaler accelerates digital transformation to ensure our customers can be more agile, efficient, resilient, and secure. As an AI-forward enterprise, we are constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform. This innovation protects our customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location.

Here, impact in your role matters more than title and trust is built on results. We say, impact over activity. We seek innovators who actively use AI to amplify their impact and who thrive in an environment where we leverage intelligent systems to stay ahead of evolving threats. We believe in transparency and value constructive, honest debate—we’re focused on getting to the best ideas, faster. We build high-performing teams that can make an impact quickly and with high quality. To do this, we are building a culture of execution centered on customer obsession, collaboration, ownership, and accountability.

We value high-impact, high-accountability with a sense of urgency where you’re enabled to do your best work and embrace your potential. If you’re driven by purpose, thrive on solving complex challenges, and want to be part of the team that’s helping to secure the AI age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity.

Role
We are looking for a Sr. Staff AI Platform Engineer to join our team. This is an On-site role based in Bangalore/Pune, reporting to the Senior Manager in the IT Data Strategy department. In this position, you will design, scale, and maintain enterprise cloud infrastructure and platform capabilities to support production AI/ML workloads. Operating within the IT Data Strategy team, you will drive infrastructure automation, observability, and platform governance while empowering AI and data engineering teams to deliver high-impact solutions reliably and securely.

What you’ll do (Role Expectations)

  • Design, build, and maintain scalable, secure, and highly available AWS infrastructure (EKS, Lambda, ECS, VPC, IAM) for AI/ML workloads using Terraform, following IaC best practices including reusable modules, remote state management, and environment-based blueprints

  • Own and continuously evolve GitLab CI/CD pipelines for AI platform services, automating build, test, security scanning, and multi-environment deployment workflows to enable fast, reliable, and repeatable releases

  • Architect a centralized observability stack using Prometheus and Grafana with golden-signal dashboards across AI/ML services and infrastructure, design intelligent alerting strategies (Alertmanager, PagerDuty, OpsGenie), and lead incident response, root-cause analysis, and postmortems to improve MTTA/MTTR

  • Define and track DORA metrics to drive delivery and reliability improvements, while building self-healing, auto-scaling, and cost-optimized infrastructure for AI/ML services (LLM inference, vector databases, agent frameworks) on Kubernetes (EKS)

  • Implement infrastructure security best practices, establish platform governance standards, partner with AI/ML and data engineering teams on production-grade AI/RAG deployments, and mentor junior/mid-level engineers through design and code reviews

Who You Are (Success Profile)

  • You act like an owner with a passion for the mission, operating with integrity and navigating seamlessly between high-level platform strategy and hands-on execution.

  • You are a high-trust collaborator who is ambitious for the overall team, fostering an open feedback culture delivered with clarity and respect to build lasting trust.

  • You are driven by innovation and deep technical curiosity, continuously seeking secure, scalable, and modern solutions to complex platform engineering challenges.

  • You champion simplicity by distilling complex technical architecture, user needs, and operational concepts into clear, actionable plans and focused communication.

  • You are data-driven, leveraging analytics and measurable metrics to guide informed engineering decisions, evaluate truth, and optimize reliability.

What We’re Looking for (Minimum Qualifications)

  • Demonstrated curiosity and active exploration of AI tools, with a proven history of integrating new technologies to enhance daily workflows and augment problem-solving

  • 8+ years of experience as a Platform Engineer / Site Reliability Engineer / DevOps Engineer, including 3+ years supporting AI/ML or data platform infrastructure, with deep hands-on expertise in AWS (EKS, Lambda, ECS, VPC, IAM, S3)

  • Strong hands-on experience with Infrastructure as Code using Terraform (modules, workspaces, remote state) and designing/maintaining CI/CD pipelines with GitLab CI/CD (or equivalent), including runners and deployment automation

  • Proven expertise in centralized observability using Prometheus and Grafana (custom exporters, dashboard design, alerting rules), along with experience designing and tuning alerting/on-call systems (Alertmanager, PagerDuty, OpsGenie) and owning incident response for production services

  • Solid, hands-on understanding of DevOps/DORA metrics (deployment frequency, lead time for changes, change failure rate, MTTR) and how to use them to drive engineering improvement

  • Experience deploying and operating containerized applications on Kubernetes (EKS), including Helm charts and autoscaling (HPA, Cluster Autoscaler, Karpenter), combined with strong scripting skills in Python (and/or Go/Bash) and the ability to work independently and lead complex infrastructure initiatives with excellent communication skills befitting a Staff-level engineer

What Will Make You Stand Out (Preferred Qualifications)

  • Experience with LiteLLM (including multi-geo/multi-region deployment patterns), distributed compute frameworks like Ray.io/Anyscale, workflow engines like Temporal, and agentic frameworks such as LangGraph, LangChain, or LlamaIndex

  • Working knowledge of vector database platforms (Qdrant, Pinecone, Weaviate), memory/context layers like ZEP, LLMOps/MLOps frameworks and practices (model registry, prompt versioning, feedback loops, MLflow/Kubeflow), and LLM observability/evaluation tooling such as Arize Phoenix

  • Exposure to GitOps workflows (ArgoCD/Flux), log aggregation and distributed tracing (Loki, ELK/OpenSearch, Jaeger/Tempo), cloud cost optimization (FinOps), and security/compliance frameworks (SOC 2, ISO 27001) in cloud-native environments

#LI-RR1

#LI-Hybrid

At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure.

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks, and more!

Learn more about Zscaler's hybrid working model and benefits here.

By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines.

Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link.

Pay Transparency

Zscaler complies with all applicable federal, state, and local pay transparency rules.

Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

Skills Required

  • Demonstrated curiosity and active exploration of AI tools and integration of new technologies
  • 8+ years as Platform Engineer/Site Reliability Engineer/DevOps Engineer, including 3+ years supporting AI/ML or data platform infrastructure
  • Deep hands-on expertise in AWS (EKS, Lambda, ECS, VPC, IAM, S3)
  • Infrastructure as Code using Terraform (modules, workspaces, remote state)
  • Designing and maintaining CI/CD pipelines with GitLab CI/CD (including runners and deployment automation)
  • Centralized observability using Prometheus and Grafana (custom exporters, dashboard design, alerting rules)
  • Designing and tuning alerting/on-call systems and incident response (Alertmanager, PagerDuty, OpsGenie) and owning production incident response
  • Strong understanding of DevOps/DORA metrics and using them to drive engineering improvements
  • Deploying and operating containerized applications on Kubernetes (EKS), including Helm charts and autoscaling (HPA, Cluster Autoscaler, Karpenter)
  • Strong scripting skills in Python (and/or Go/Bash) and ability to lead complex infrastructure initiatives with excellent communication
  • Experience with LiteLLM, Ray/Anyscale, Temporal, LangGraph, LangChain, LlamaIndex
  • Working knowledge of vector databases (Qdrant, Pinecone, Weaviate), memory/context layers like ZEP, MLflow/Kubeflow, Arize Phoenix
  • Exposure to GitOps (ArgoCD/Flux), log aggregation and tracing (Loki, ELK/OpenSearch, Jaeger/Tempo), FinOps, and security/compliance frameworks (SOC 2, ISO 27001)

What the Team is Saying

Zscaler Compensation & Benefits Highlights

  • Healthcare Strength Benefits include multiple medical plan choices, vision coverage, and robust mental‑health resources such as Lyra, 24/7 EAP access via Telus, and Calm app access. Disability and life insurance are also company‑paid in many cases, and some regions offer virtual primary care and screenings.
  • Leave & Time Off Breadth Time off is described as flexible for many salaried roles, with generous PTO/holidays and paid sick, bereavement, and military leave. Region‑specific pages indicate the company regularly reviews and updates leave programs.
  • Parental & Family Support U.S. materials outline fully paid bonding time for all parents and disability coverage for birthing parents, plus a paid ramp‑back option after leave. Family‑building support and adoption assistance are noted on benefits pages.

Zscaler Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Jose, CA
8,697 Employees
Year Founded: 2007

What We Do

Zscaler accelerates digital transformation so our customers can be more agile, efficient, resilient, and secure. Our cloud native Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location.

Why Work With Us

Our impact comes from how we work—every day, in every decision, as one team. Our values and leadership principles are more than words; they're our operating system. They fuel a culture of execution where trust, transparency, and accountability help us deliver meaningful results for our customers, colleagues, and our company. www.zscaler.com/culture

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Zscaler Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: 3 days a week
HQSan Jose Headquarters
Tokyo
Alpharetta, GA
Amsterdam, NL
Bellevue, WA
Bengaluru, IN
Boston, MA
Burnaby, BC
Frankfurt am Main, DE
Gurugram, Haryana
Hyderabad, Telangana
Kita, JP
London, GB
Madrid, Madrid
Melbourne, VIC
Milan, IT
Mohali, Punjab
Mumbai, Maharashtra
München, DE
New York, NY
Paris, FR
Plano, TX
Pune, Maharashtra
Ramat Gan, IL
San Rafael, San Rafael de Escazú
Singapore, SG
Stockholm, SE
Sydney, Sydney
Valencia, ES
Wien, AT
Wrocław, PL
Zürich, CH
Learn more

Similar Jobs

Zscaler Logo Zscaler

Strategic Accounts & Pursuits Lead

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
2 Locations
8697 Employees

Zscaler Logo Zscaler

Business Systems Analyst

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
India
8697 Employees

Zscaler Logo Zscaler

Business Systems Analyst

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
India
8697 Employees

Zscaler Logo Zscaler

Principal AI Security Specialist

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
3 Locations
8697 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account