Machine Learning Engineer – AI Labs

Posted Yesterday
Santa Clara, CA, USA
In-Office
128K-261K Annually
Junior
Cloud • Security • Software • Cybersecurity
The Role
Build and deploy production-grade AI/ML inference systems for a cloud security platform. Optimize LLM serving (vLLM, SGLang, KV cache), implement model evaluation/reporting, and collaborate with ML scientists and engineers to execute the AI roadmap.
Summary Generated by Built In
About Netskope

Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Netskope to redefine Cloud, Network and Data Security. 

Since 2012, we have built the market-leading cloud security company and an award-winning culture powered by hundreds of employees spread across offices in Santa Clara, St. Louis, Bangalore, London, Paris, Melbourne, Taipei, and Tokyo. Our core values are openness, honesty, and transparency, and we purposely developed our open desk layouts and large meeting spaces to support and promote partnerships, collaboration, and teamwork. From catered lunches and office celebrations to employee recognition events and social professional groups such as the Awesome Women of Netskope (AWON), we strive to keep work fun, supportive and interactive.  Visit us at Netskope Careers. Please follow us on LinkedIn and Twitter@Netskope.

About Netskope & AI Labs

Within Netskope Engineering, Netskope AI Labs is the powerhouse advancing state-of-the-art artificial intelligence (AI) and machine learning (ML) to protect the modern enterprise. We build the intelligence behind the Netskope Intelligent Security Service Edge (SSE) platform.

We are seeking a high-caliber Machine Learning Engineer to help us build, optimize, and deploy enterprise-scale AI solutions. Working closely with senior architects, you will directly influence our Secure Access Service Edge (SASE) architecture, turning cutting-edge AI research into production-grade reality.

Note on Leveling: We believe great talent doesn't always fit into a rigid box. Candidates are assessed individually and leveled (from mid to senior) according to their specific skills, background, and technical depth.

🚀 What’s in it for You?
  • High-Impact Ownership: You aren't just maintaining pipelines; you are playing a critical role in the AI transformation of a market-leading cloud security company.
  • Cutting-Edge Stack: Work on the bleeding edge of LLM inference optimization, utilizing tools like vLLM, SGLang, and advanced KV Cache optimization.
  • Elite Collaboration: Work alongside top-tier engineers, researchers, and ML scientists to solve the industry’s toughest challenges in latency, throughput, and cloud security.
🛠️ What You Will Do
  • Collaborate on the AI Roadmap: Play a key role alongside senior architects and team members in driving the execution of critical AI/ML technical strategies, building highly scalable, reliable, and production-grade systems.
  • Architect High-Performance Inference Systems: Design, optimize, and deploy enterprise-scale LLM serving infrastructures. You will push the boundaries of throughput and latency.
  • Own the End-to-End AI Lifecycle: Partner closely with ML scientists and product stakeholders to translate complex business requirements into elegant, deployed code.
  • Enforce AI Excellence: Implement and scale strict "Report Cards" for production models, tracking real-world accuracy, latency, and security relevance.
💡 What You Bring
  • Industry Experience: 10+ years of overall experience in software engineering and product development, with a specialized focus in one of two tracks:
    • The AI/ML Focus: 2+ years of production experience developing, optimizing, and deploying AI/ML solutions (or an equivalent blend of an advanced technical degree + hands-on experience).
    • The Distributed Systems Focus: 6+ years of deep experience architecting, building, and scaling high-performance distributed systems, combined with a strong desire to apply those infrastructure skills to cutting-edge AI/LLM engineering.
  • The Modern AI Stack: Direct exposure to (or a strong conceptual understanding of) optimizing LLMs in production. Familiarity with high-throughput inference frameworks (e.g., vLLM, SGLang, TensorRT-LLM) and memory management techniques like KV Cache optimization is a massive plus.
  • Clear Communication: The ability to distill complex technical architecture or infrastructure bottlenecks into clear, actionable concepts for cross-functional teams.
  • The Startup Mindset: You are an energetic self-starter who thrives in fast-paced, dynamic environments and isn't afraid to wear multiple hats to get a product across the finish line.
Education
  • BSCS or equivalent required, MSCS or equivalent strongly preferred.

Compensation: 

At Netskope, salary is one component of our competitive total rewards package. The salary range for this position is as listed below. This is a national range. For purposes of complying with applicable laws, the range applies to candidates in California, Colorado, Illinois, Maryland, New York, Washington, and other states.

The successful candidate’s starting pay will also be determined based on job-related skills, experience, qualifications, location, and market conditions. 

For all sales roles, the posted salary range is the On Target Earnings (OTE) range for the role, which is the sum of base salary and target commission amount at 100% goal achievement.

In addition to salary, candidates may be eligible for other forms of compensation such as participation in a bonus plan (for non-sales roles) and a stock award program. Candidates may also be eligible for a comprehensive health plan and other benefits that can be reviewed at Netskope Benefits site. 

Salary Range
$128,000$260,500 USD

Netskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate.

Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope's Privacy Policy for more details.

The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site.

Skills Required

  • 2+ years industry experience in developing AI/ML solutions
  • Hands-on experience optimizing LLMs in production environments
  • Experience with vLLM
  • Experience with SGLang
  • Experience with KV Cache optimization
  • Experience designing, optimizing, and deploying scalable inference systems
  • Strong communication skills to work with cross-functional teams
  • Energetic self-starter willing to wear multiple hats in a fast-paced environment
  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related technical field

Netskope Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Netskope and has not been reviewed or approved by Netskope.

  • Fair & Transparent Compensation Pay is considered competitive in U.S. technical roles, with indications that total compensation benchmarks strongly versus peers. Employees are generally pleased with total compensation that includes pay, stock, equity, and benefits.
  • Healthcare Strength Health coverage offers multiple medical plan choices alongside dental, vision, disability, HSA/FSA, and EAP, and is often characterized as very good. Employer-verified plan options and regional choices reinforce the breadth and quality of coverage.
  • Leave & Time Off Breadth Time off includes flexible/unlimited PTO, paid holidays, and quarterly wellness days that support rest and flexibility. Paid parental leave is available, commonly cited at 12 weeks for birth parents and 8 weeks for non‑birth parents.

Netskope Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Bogotá
1,479 Employees
Year Founded: 2012

What We Do

Netskope, the SASE leader, safely and quickly connects users directly to the internet, any application, and their infrastructure from any device, on or off the network. With CASB, SWG, and ZTNA built natively in a single platform, the Netskope Security Cloud provides the most granular context, via patented technology, to enable conditional access and user awareness while enforcing zero trust principles across data protection and threat prevention everywhere. Unlike others who force tradeoffs between security and networking, Netskope’s global security private cloud provides full compute capabilities at the edge. Netskope is fast everywhere, data-centric, and cloud-smart, all while enabling good digital citizenship and providing a lower total-cost-of-ownership.

Similar Jobs

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

HPE Labs - Principal AI and Machine Learning Research Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
2 Locations
85422 Employees
160K-349K Annually

Upside Logo Upside

Strategic Account Manager

Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Remote or Hybrid
USA
275 Employees
140K-152K Annually

PwC Logo PwC

UKG WFM Pro - Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
San Francisco, CA, USA
370000 Employees
99K-232K Annually

PwC Logo PwC

Front Office Strategy Consulting - PLS Customer Analytics - Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
9 Locations
370000 Employees
99K-232K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account