Principal Engineer, Secure AI Gateway

Posted 9 Days Ago
Be an Early Applicant
Santa Clara, CA, USA
In-Office
134K-272K Annually
Expert/Leader
Cloud • Security • Software • Cybersecurity
The Role
Lead architecture and development of Netskope’s secure AI Gateway, building scalable, high-performance systems that route, inspect, transform, and secure LLM and API traffic. Responsibilities include designing distributed microservices, threat detection, dynamic multi-provider orchestration, credential management, DLP integration, and real-time content analysis. The role provides technical leadership, mentors engineers, partners with product teams, conducts reviews, and guides global engineering collaboration.
Summary Generated by Built In
Join the Future of Security at Netskope

Netskope (NASDAQ: NTSK) is a leader in modern security and networking for the cloud and AI era. We secure and accelerate cloud, data, and AI in real time, everywhere. Thousands of customers, including more than 30 of the Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain full visibility and control without performance trade-offs.

At Netskope, our technology is driven by our greatest strength: our people. We believe that belonging powers innovation, and success is both personal and organizational. We embrace differences in gender, ethnicity, beliefs, ability, and identity, creating an environment where every voice is heard and respected. We empower our employees to bring their authentic selves to work, grow their careers through continuous education and mentorship, and lead with transparency and curiosity. Join a team where you belong, where you are encouraged to be an entrepreneur, and where together, we continue to redefine the landscape of security.

Visit Careers at Netskope to learn more. Follow us on LinkedIn and Instagram.

Please note, this team is hiring across all levels and candidates are individually assessed and appropriately leveled based upon their skills and experience.

About the role

Netskope Cloud Data Plane engineers architect and design one of the most scalable, high-performance cloud API routing and orchestration platforms in the world, processing 10+ Gbps of traffic, performing intelligent routing and policy application across LLM providers and AI services using advanced techniques to detect threats and apply dynamic policies, all at line rate.

What's in it for you

In this role you will help lead the Netskope AI Security Gateway - a platform that empowers enterprises to securely unlock the transformative power of Generative AI and LLMs at scale. You will conduct technical research, collaborate with internal engineering and product management teams, collaborate with engineers in US, Taiwan and India to design, develop and integrate innovative security capabilities into our platform. You'll own architectural decisions that affect how the platform routes, transforms, secures and inspects API traffic across LLM providers, AI services and cloud platforms.  

What you will be doing
  • Design, architect and develop high performance, scalable cloud-based security systems to detect and mitigate threats on LLM APIs and Generative AI applications
  • Setting and driving the overall architectural design and strategic technical directions for the Cloud API Gateway platform
  • Define and drive best practices around scalable microservices, distributed systems, APIs and secure data flows across multiple LLM providers (Layer 3 to Layer 7)
  • Lead and inspire a world-class engineering organization, fostering a culture of innovation, collaboration and continuous improvement
  • Partner with product management to understand customer requirements, lead the team and collaborate with other engineering teams to design and implement high-quality solutions
  • Build scalable and performant services that route, transform and secure various API protocols (LLM APIs, REST, gRPC, etc.), using advanced data structures and algorithms in GoLang. Perform deep inspection of LLM API traffic in real-time to detect and mitigate attacks on AI services
  • Design and implement dynamic routing algorithms for multi-provider LLM orchestration, intelligent request transformation, load balancing, and failover logic
  • Integrate with security features including DLP, Threat protection, and UEBA for LLM-specific attack pattern recognition, content inspection and policy application
  • Implement sophisticated credential and token management algorithms for secure multi-provider orchestration
  • Perform architectural reviews, code reviews and mentor junior engineers
  • Stay abreast of emerging GenAI and cybersecurity technologies, proactively propose innovative solutions
Required skills and experience
  • 10 to 12+ years of experience in software engineering, with 5+ years in architectural or technical leadership role
  • Deep expertise in backend engineering using Golang, or similar languages. Ability to review code in GoLang and similar languages, such as C and C++.
  • Proven experience designing large-scale, secure and cloud-native systems
  • Expertise in building high throughput and low latency data systems, such as networking from Layer 3 to Layer 7, web proxy, load balancing, request routing, API gateways, security, monitoring and observability, distributed systems, data processing, etc.
  • Expertise in dealing with complex architectural problems across multiple products and at the same time handling design issues at module level
  • Strong understanding of computer architecture – multi-threading, CPU scheduling, memory management with practical knowledge of Linux at system/kernel level
  • Hands-on experience with Docker and Kubernetes, specifically debugging workloads, networking, and storage in on-prem or hybrid environments
  • Hands-on experience handling complex and ambiguous customer issues. Persistence in accomplishing objectives despite uncertain situations, obstacles, and setbacks
  • Excellent communication skills and the ability to position views and arguments appropriately to win support. The ability to negotiate skillfully in tough situations to win concessions without damaging relationships
  • Confidence under pressure, a mature EQ, and the ability to show a high degree of self control while maintaining a positive attitude despite adversity
  • Willingness to work with a globally distributed team in different time zones, including US, Taiwan and India.
  • The ability to represent the company in appropriate external forums and industry events promoting technical thought leadership
  • Startup experience in a fast-paced environment is a plus
Additional Skills and Knowledge
  • Strong analytical and troubleshooting skills using debuggers like gdb and tools like Valgrind
  • Proponent of TDD, knowledge of various unit testing frameworks
  • Experience with LLM APIs, Generative AI platforms, and multi-provider orchestration
  • Deep packet inspection and real-time content analysis at line rate
  • Experience with threat detection, DLP, and security policy enforcement
  • Deep knowledge of GenAI and cybersecurity convergence: prompt injection, jailbreak mitigation, LLM-specific threat patterns
  • Experience implementing key management and credential handling algorithms
  • Integration with security features such as DLP, Threat protection, and UEBA
  • Knowledge of emerging GenAI and cloud service security challenges and best practices
Education
  • BSCS or equivalent required, MSCS or equivalent strongly preferred

Compensation: 

At Netskope, salary is one component of our competitive total rewards package. The salary range for this position is as listed below. This is a national range. For purposes of complying with applicable laws, the range applies to candidates in California, Colorado, Illinois, Maryland, New York, Washington, and other states.

The successful candidate’s starting pay will also be determined based on job-related skills, experience, qualifications, location, and market conditions. 

For all sales roles, the posted salary range is the On Target Earnings (OTE) range for the role, which is the sum of base salary and target commission amount at 100% goal achievement.

In addition to salary, candidates may be eligible for other forms of compensation such as participation in a bonus plan (for non-sales roles) and a stock award program. Candidates may also be eligible for a comprehensive health plan and other benefits that can be reviewed at Netskope Benefits site. 

Salary Range
$133,500—$272,000 USD

Netskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate.

Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope's Privacy Policy for more details.

The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site.

Skills Required

  • 10 to 12+ years of software engineering experience
  • 5+ years in an architectural or technical leadership role
  • Deep backend engineering expertise using Golang or similar languages, including code review in Go, C, or C++
  • Experience designing large-scale, secure, cloud-native systems
  • Expertise in high-throughput, low-latency systems, networking, web proxies, load balancing, request routing, API gateways, security, observability, distributed systems, or data processing
  • Experience solving complex architectural and module-level design problems across multiple products
  • Strong understanding of computer architecture, multithreading, CPU scheduling, memory management, and Linux system or kernel-level operation
  • Hands-on Docker and Kubernetes experience, including workload, networking, and storage debugging in on-premises or hybrid environments
  • Experience handling complex and ambiguous customer issues
  • Excellent communication, negotiation, and stakeholder-influence skills
  • Ability to work effectively with globally distributed teams across different time zones
  • Ability to represent the company at external forums and industry events
  • Strong analytical and troubleshooting skills using tools such as gdb and Valgrind
  • Knowledge of test-driven development and unit testing frameworks
  • Experience with LLM APIs, Generative AI platforms, and multi-provider orchestration
  • Experience with deep packet inspection and real-time content analysis at line rate
  • Experience with threat detection, DLP, security policy enforcement, prompt injection, and jailbreak mitigation
  • Experience implementing key management and credential-handling algorithms
  • Knowledge of GenAI, cybersecurity convergence, and cloud security challenges
  • BSCS or equivalent degree
  • MSCS or equivalent degree
  • Startup experience in a fast-paced environment

Netskope Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Netskope and has not been reviewed or approved by Netskope.

  • Fair & Transparent Compensation — Pay is considered competitive in U.S. technical roles, with indications that total compensation benchmarks strongly versus peers. Employees are generally pleased with total compensation that includes pay, stock, equity, and benefits.
  • Healthcare Strength — Health coverage offers multiple medical plan choices alongside dental, vision, disability, HSA/FSA, and EAP, and is often characterized as very good. Employer-verified plan options and regional choices reinforce the breadth and quality of coverage.
  • Leave & Time Off Breadth — Time off includes flexible/unlimited PTO, paid holidays, and quarterly wellness days that support rest and flexibility. Paid parental leave is available, commonly cited at 12 weeks for birth parents and 8 weeks for non‑birth parents.

Netskope Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
1,479 Employees
Year Founded: 2012

What We Do

Netskope, the SASE leader, safely and quickly connects users directly to the internet, any application, and their infrastructure from any device, on or off the network. With CASB, SWG, and ZTNA built natively in a single platform, the Netskope Security Cloud provides the most granular context, via patented technology, to enable conditional access and user awareness while enforcing zero trust principles across data protection and threat prevention everywhere. Unlike others who force tradeoffs between security and networking, Netskope’s global security private cloud provides full compute capabilities at the edge. Netskope is fast everywhere, data-centric, and cloud-smart, all while enabling good digital citizenship and providing a lower total-cost-of-ownership.

Similar Jobs

MetLife Logo MetLife

Director, Group Benefits Data Strategy

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
125K-170K Annually

MetLife Logo MetLife

Senior Accounting Assistant - 20009

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-50K Annually

ServiceNow Logo ServiceNow

Scientist

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Santa Clara, CA, USA
29000 Employees
203K-354K Annually

True Anomaly Logo True Anomaly

Epsilon3 Administrator

Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
In-Office
Long Beach, CA, USA
300 Employees
95K-170K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account