Staff / Sr. Staff Engineer, AI Gateway

Posted 9 Days Ago
Be an Early Applicant
Taipei City, TWN
In-Office
Senior level
Cloud • Security • Software • Cybersecurity
The Role
Architect, build, and scale secure, high-throughput Golang microservices for Netskope’s AI Gateway across SaaS and hybrid environments. Design distributed systems supporting streaming LLM responses, proxy routing, and enterprise security. Debug complex Kubernetes, networking, TLS, and asynchronous-service issues; participate in on-call ownership; and drive architectural reviews, code quality, mentorship, and AI-assisted engineering practices.
Summary Generated by Built In
Join the Future of Security at Netskope

Netskope (NASDAQ: NTSK) is a leader in modern security and networking for the cloud and AI era. We secure and accelerate cloud, data, and AI in real time, everywhere. Thousands of customers, including more than 30 of the Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain full visibility and control without performance trade-offs.

At Netskope, our technology is driven by our greatest strength: our people. We believe that belonging powers innovation, and success is both personal and organizational. We embrace differences in gender, ethnicity, beliefs, ability, and identity, creating an environment where every voice is heard and respected. We empower our employees to bring their authentic selves to work, grow their careers through continuous education and mentorship, and lead with transparency and curiosity. Join a team where you belong, where you are encouraged to be an entrepreneur, and where together, we continue to redefine the landscape of security.

Visit Careers at Netskope to learn more. Follow us on LinkedIn and Instagram.

Please note, this team is hiring across all levels and candidates are individually assessed and appropriately leveled based upon their skills and experience.

About the Role

Netskope AI Gateway helps global enterprises securely adopt, scale, and govern Generative AI. We are seeking a Staff / Sr. Staff Software Engineer to architect, build, and scale the core systems powering our AI Gateway product and its supporting microservices across SaaS and on-prem/hybrid environments.

Based in Taiwan, you will be a technical anchor for our core development team. This is a hands-on, high-impact individual contributor role focused on building highly scalable backend systems, with real ownership: the systems assigned to you are yours to design, build, and defend — depth matters more than volume. You will operate at the intersection of deep distributed systems engineering and cutting-edge AI technology. We are looking for an engineering leader who leverages AI to accelerate their workflows, but possesses the rigorous, production-grade coding skills required to architect complex systems, ensure enterprise-grade security, and validate AI-generated code.

What You Will Be Doing
  • Core Backend Development: Architect, build, and scale our core AI Gateway solutions, backend services, and high-throughput APIs. You will focus on writing highly concurrent, robust, and maintainable software, primarily in Golang.
  • Command AI-Driven Engineering: Integrate AI and agent-based tooling (e.g., Copilots, code generators) into your daily development workflow to accelerate scaffolding, boilerplate, and hypothesis generation. Crucially, you will act as the gatekeeper: you must possess the deep software engineering expertise to audit AI-generated code, ensure architectural soundness, and reject code that introduces technical debt or security flaws.
  • Design for Scale and Resilience: Build distributed systems capable of handling immense data payloads, streaming LLM responses (Server-Sent Events), and complex proxy routing without introducing unacceptable latency.
  • Cross-Functional Collaboration: Partner directly with global engineering, AI researchers, and product teams. Translate ambitious AI features into scalable, maintainable software architectures. Raise system design considerations before a single line of feature code is written.
  • Push Engineering Excellence: Drive the technical culture of the Taiwan team through architectural reviews, code reviews, and mentorship. Advocate for best practices in modern, AI-augmented software development, security, and scalable system design.
  • Deep Systems Debugging: While not primarily an incident support role, you will be the ultimate escalation point for the hardest systemic development roadblocks. Trace complex issues across asynchronous microservices, Kubernetes networking layers, and TLS/Proxy protocols to architect permanent structural fixes.
  • Share Production Ownership: Own what you ship — participate in the team's shared on-call rotation, monitor the health of your services, and turn recurring incidents into structural fixes.
What Success Looks Like
  • Architectural Delivery: You translate ambiguous product requirements into clean, scalable, and secure Golang microservices that handle high throughput and streaming responses with minimal latency.
  • AI-Augmented Technical Rigor: You consistently accelerate your output using AI coding tools, but the code you merge is rigorously vetted, secure, and architecturally sound, ensuring all hallucinations are caught.
  • Elevating Engineering Standards: The technical excellence of the Taiwan team rises because of your presence. Your design documents, code reviews, and mentorship prevent systemic debt before feature code is written.
  • Definitive Problem Solving: When complex cross-boundary roadblocks occur, such as proxy bottlenecks or async race conditions, you deliver definitive root causes and permanent structural fixes.
  • Systemic Resilience: The AI Gateway maintains high availability and strict security enforcement while gracefully handling the evolution of major LLM provider APIs and scaling customer traffic.
Required Skills and Experience
  • Engineering Experience: 8-10+ years in software engineering, with at least 5+ years deeply focused on backend development, cloud-native services, and distributed systems.
  • Production-Grade Coding: Exceptional software engineering skills in Golang (highly preferred) or Python. You build modular libraries, reliable microservices, and scalable frameworks from scratch. You do not just prompt; you write software.
  • AI-Assisted Workflow Proficiency: Demonstrated experience using advanced LLM-based coding agents in real engineering work. You understand where AI accelerates development and where it introduces technical debt or hallucinations, and you have a clear track record of catching what the AI misses.
  • System Architecture: Expertise in microservices architecture, RESTful/gRPC API design, and navigating complex distributed system trade-offs (consistency vs. availability, caching strategies, asynchronous processing).
  • Networking & Gateway Fundamentals: Deep understanding of Layer 4-7 networking: proxy architectures, HTTP/S, TLS interception, DNS, TCP/IP, and load balancing.
  • Infrastructure & Kubernetes: Deep, hands-on experience developing for and debugging services on Docker/Kubernetes. You understand K8s networking, service discovery, and deployment strategies in cloud or hybrid environments.
  • Autonomy & Communication: Track record of taking under-specified, ambiguous problems and driving them to working software solutions. Exceptional verbal and written English for complex technical collaboration across global teams.
Nice to Have
  • GenAI Ecosystem: Familiarity with the request/response schemas of major LLM providers (OpenAI, Anthropic, Gemini), streaming formats, agentic protocols such as MCP and A2A, and orchestration frameworks like LangChain or LlamaIndex.
  • Cybersecurity Domain: Background in Secure Web Gateways (SWG), Zero Trust Network Access (ZTNA), or Data Loss Prevention (DLP).
  • Cloud Platforms: Experience developing and operating scalable services in AWS, GCP, or Azure.
  • Event Streaming: Experience with message brokers and event-driven architectures (e.g., Apache Kafka).
  • Observability: Strong grasp of embedding observability (OpenTelemetry, Prometheus, Grafana) directly into application code.
Education
  • BS in Computer Science, Software Engineering, or equivalent practical experience required; MS strongly preferred.

Netskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate.

Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope's Privacy Policy for more details.

The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site.

Skills Required

  • 8–10+ years of software engineering experience
  • At least 5+ years of backend development, cloud-native services, and distributed systems experience
  • Exceptional production-grade software engineering skills in Golang or Python
  • Experience building modular libraries, reliable microservices, and scalable frameworks from scratch
  • Demonstrated experience using advanced LLM-based coding agents in production engineering work
  • Expertise in microservices architecture and RESTful or gRPC API design
  • Understanding of distributed-systems trade-offs, consistency, availability, caching, and asynchronous processing
  • Deep knowledge of Layer 4–7 networking, proxy architectures, HTTP/S, TLS interception, DNS, TCP/IP, and load balancing
  • Hands-on experience developing and debugging services on Docker and Kubernetes
  • Experience with Kubernetes networking, service discovery, and deployment strategies in cloud or hybrid environments
  • Track record of independently solving ambiguous technical problems
  • Exceptional verbal and written English for complex technical collaboration
  • BS in Computer Science, Software Engineering, or equivalent practical experience
  • MS degree in a related field

Netskope Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Netskope and has not been reviewed or approved by Netskope.

  • Fair & Transparent Compensation Pay is considered competitive in U.S. technical roles, with indications that total compensation benchmarks strongly versus peers. Employees are generally pleased with total compensation that includes pay, stock, equity, and benefits.
  • Healthcare Strength Health coverage offers multiple medical plan choices alongside dental, vision, disability, HSA/FSA, and EAP, and is often characterized as very good. Employer-verified plan options and regional choices reinforce the breadth and quality of coverage.
  • Leave & Time Off Breadth Time off includes flexible/unlimited PTO, paid holidays, and quarterly wellness days that support rest and flexibility. Paid parental leave is available, commonly cited at 12 weeks for birth parents and 8 weeks for non‑birth parents.

Netskope Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
1,479 Employees
Year Founded: 2012

What We Do

Netskope, the SASE leader, safely and quickly connects users directly to the internet, any application, and their infrastructure from any device, on or off the network. With CASB, SWG, and ZTNA built natively in a single platform, the Netskope Security Cloud provides the most granular context, via patented technology, to enable conditional access and user awareness while enforcing zero trust principles across data protection and threat prevention everywhere. Unlike others who force tradeoffs between security and networking, Netskope’s global security private cloud provides full compute capabilities at the edge. Netskope is fast everywhere, data-centric, and cloud-smart, all while enabling good digital citizenship and providing a lower total-cost-of-ownership.

Similar Jobs

Motive Logo Motive

Manager, Hardware Reliability Engineering

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
Taipei City, TWN
4000 Employees

Ericsson Logo Ericsson

Head of Analytics Taiwan and Hong Kong

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Taipei City, TWN
88000 Employees

Micron Technology Logo Micron Technology

Principal, Emerging Tech & Market Enablement

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Taipei City, TWN
45000 Employees

Shield AI Logo Shield AI

Sr Proposal Manager - Taiwan

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Remote or Hybrid
Taipei, TWN

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account