Senior/Staff AI Engineer

Posted 4 Days Ago
Hiring Remotely in California, USA
Remote or Hybrid
Senior level
Artificial Intelligence • Machine Learning • Software • Analytics
The Role
Build and optimize production LLM serving and inference systems, improving GPU and CPU performance, memory usage, KV caching, storage, throughput, and latency. Design scalable infrastructure for RAG and retrieval-heavy workloads while solving distributed systems challenges across compute, memory, and storage. The role requires hands-on ownership of AI infrastructure and the ability to balance architecture decisions with implementation in performance-critical environments.
Summary Generated by Built In

What you’ll do
  • Build and optimize LLM serving and inference systems for production environments

  • Improve performance across GPU and CPU pathways

  • Work on KV cache, memory, storage, and throughput bottlenecks

  • Design and scale systems that support RAG and retrieval-heavy AI workloads

  • Contribute to infrastructure where storage architecture and systems efficiency materially affect AI performance

  • Solve engineering problems at the intersection of AI, high-performance systems, and distributed infrastructure

What we’re looking for
  • An engineer who has spent meaningful time building or optimizing production AI systems, not just experimenting with models

  • Someone who understands how inference performance is shaped by the interaction between compute, memory, storage, and serving architecture

  • Deep hands-on experience working close to the systems layer — for example, improving how workloads run across GPU and CPU resources, reducing bottlenecks, or tuning infrastructure for better throughput and latency

  • Evidence of real ownership in areas like model serving, retrieval, caching, storage, or distributed performance, rather than purely application-layer AI work

  • The ability to move comfortably between architecture decisions and hands-on implementation, especially in environments where efficiency and scale matter

  • A background that suggests you can operate in technically demanding environments, whether that comes from AI infrastructure, high-performance systems, storage platforms, or adjacent distributed systems work

  • PhD preferred, but far less important than having built serious systems in the real world

Why this role is compelling
  • This is not a “prompt engineering” job.

  • This is not an “AI wrapper” job.

  • This is not a generic backend role with AI sprinkled on top.

  • This is a chance to work on the infrastructure that determines whether modern AI systems are fast, scalable, efficient, and commercially viable.

  • If you want to work on the real mechanics of AI performance — serving, retrieval, compute efficiency, memory behavior, storage architecture, and inference at scale — this is where that work happens.

Who will love this role
  • Engineers who enjoy deep systems problems

  • Builders who care about performance, scale, and architecture

  • People who want to work where AI meets infrastructure

  • Candidates who would rather solve hard technical bottlenecks than ship surface-level AI features

Who should not apply

This role is not for:

  • Purely academic researchers without meaningful production ownership

  • Generic software engineers without clear AI systems or inference depth

  • Candidates focused mainly on prompt engineering or lightweight application integrations

  • MLOps generalists who have not worked deeply on serving, storage, or performance-critical AI systems

Skills Required

  • Meaningful experience building or optimizing production AI systems
  • Hands-on experience with AI inference performance and serving architecture
  • Experience optimizing workloads across GPU and CPU resources
  • Experience with compute, memory, storage, throughput, or latency bottlenecks
  • Ownership of model serving, retrieval, caching, storage, or distributed performance systems
  • Ability to work between systems architecture and hands-on implementation
  • Background in AI infrastructure, high-performance systems, storage platforms, or distributed systems
  • PhD
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chatsworth, CA
706 Employees
Year Founded: 1998

What We Do

DDN is the world’s largest private data storage company and the leading provider of intelligent technology and infrastructure solutions for Enterprise At Scale, AI and analytics, HPC, government and academia customers. Through its DDN and Tintri divisions, the company delivers AI, Data Management software and hardware solutions, and unified analytics frameworks to solve complex business challenges for data-intensive, global organizations. DDN provides its enterprise customers with the most flexible, efficient and reliable data storage solutions for on-premises and multi-cloud environments at any scale. Over the last two decades, DDN has established itself as the data management provider of choice for over 11,000 enterprises, government, and public-sector customers, including many of the world’s leading financial services firms, life science organizations, manufacturing and energy companies, research facilities, and web and cloud service providers.

Similar Jobs

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Remote or Hybrid
5 Locations
55000 Employees
286K-392K Annually

Clear Street Logo Clear Street

Senior / Staff AI Model Engineer

Fintech • Software • Financial Services
Easy Apply
Remote or Hybrid
USA
581 Employees
200K-350K Annually

Rula Logo Rula

Staff Engineer

Healthtech • Social Impact • Software • Telehealth
Remote
United States
630 Employees
242K-288K Annually

ServiceNow Logo ServiceNow

Senior Staff AI Agent Engineer – Moveworks | Customer Deployment

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
San Francisco, CA, USA
29000 Employees
191K-334K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account