Senior Solutions Engineer, AI Infrastructure

Posted 3 Days Ago
Hiring Remotely in United States
Remote or Hybrid
Senior level
Artificial Intelligence • Software
The Role
The Senior Solutions Engineer will design and implement infrastructure for AI and HPC workloads, engage with customers, and lead technical discovery and architecture design.
Summary Generated by Built In
Description

We're looking for a deeply technical Solutions Architect to help customers design, evaluate, and deploy infrastructure for large-scale AI, HPC, analytics, and data-intensive workloads.

This is a customer-facing technical role for someone who has lived inside production infrastructure. You may have been a platform engineer, infrastructure engineer, SRE, MLOps engineer, AI infrastructure engineer, storage engineer, cloud engineer, or HPC systems engineer. What matters most is that you have built, operated, or architected real systems, and can bring that credibility into customer conversations.

Our customers are building infrastructure at serious scale: GPU clusters, high-performance storage systems, Kubernetes platforms, distributed training environments, inference platforms, data pipelines, lakehouses, and large enterprise systems. You'll help them reason about architectures involving 10,000+ GPUs, 100PB+ of storage, high-performance networking, distributed filesystems, orchestration layers, and demanding production workloads.

You'll own technical discovery, architecture design, PoC planning, competitive positioning, and customer technical strategy. You'll work from the first whiteboard session through evaluation, deployment planning, and production success. You'll also partner closely with product and engineering teams to bring field feedback into the roadmap.

We're looking for someone who can go deep technically, communicate clearly, operate without a rigid playbook, and translate complex infrastructure into customer outcomes.

Responsibilities

  • Lead technical discovery with customers across infrastructure, platform, ML, data, and executive stakeholders.
  • Design architectures for large-scale AI, HPC, analytics, and enterprise data workloads.
  • Help customers evaluate infrastructure involving GPUs, storage, networking, orchestration, and data movement.
  • Design and execute proofs of concept that validate performance, scale, reliability, and business value.
  • Translate complex technical requirements into clear solution designs, reference architectures, and deployment guidance.
  • Debug customer issues across Linux, storage, networking, Kubernetes, schedulers, GPUs, and application workloads.
  • Build technical assets, demos, runbooks, and field guidance for repeatable customer engagements.
  • Partner with sales on technical strategy, competitive positioning, and deal execution.
  • Partner with product and engineering to communicate customer requirements, gaps, and roadmap opportunities.
  • Help customers move from architecture design to production deployment.
Requirements
  • 8 to 12+ years of technical experience, with significant hands-on infrastructure experience.
  • Experience building, operating, or architecting production platform infrastructure.
  • Strong understanding of Linux kernel implementation details, distributed systems including PAXOS and raft, storage implementations details like NAND or write amplification, networking store/forward, load balancing designs, and production operations.
  • Experience with one or more of: GPU infrastructure, large scale HPC systems, Kubernetes platforms from scratch, MLOps, storage systems, cloud infrastructure, data platforms, or large-scale enterprise infrastructure.
  • Ability to communicate credibly with engineers, architects, technical executives, and business stakeholders.
  • Strong discovery, problem-solving, and systems debugging skills.
  • Comfort operating in ambiguous, fast-moving environments.
  • Interest in customer-facing technical work, solution design, and business outcomes.

Preferred Experience

  • Experience with large-scale GPU clusters, distributed training, inference infrastructure, or AI platforms.
  • Experience with petabyte-scale storage or high-performance data systems.
  • Experience with Kubernetes, Slurm, Ray, Spark, or other orchestration / scheduling systems.
  • Domain Expertise with one or more of these - Lustre, Ceph, Weka, BeeGFS, GPFS, VAST, object storage, or distributed filesystems.
  • Experience with InfiniBand, RoCE, RDMA, high-performance Ethernet, or NVIDIA/Mellanox networking.
  • Direct Experience with CUDA, NCCL, DCGM, GPUDirect, checkpointing, dataset staging, or model-serving infrastructure.
  • Experience across multiple industries or customer environments.

Skills Required

  • 8 to 12+ years of technical experience
  • Significant hands-on infrastructure experience
  • Experience with GPU infrastructure or large scale HPC systems
  • Ability to communicate with engineers and business stakeholders
  • Strong discovery and systems debugging skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Brooklyn, NY
848 Employees
Year Founded: 2016

What We Do

Meet the data platform company for the AI era. Accelerating time-to-insight for workload-intensive applications, the VAST Data Platform delivers scalable performance, radically simple data management and enhanced productivity for the AI-powered world. Launched in 2019, VAST is the fastest-selling data infrastructure startup in history.

Similar Jobs

Drata Logo Drata

Solutions Engineer

Security • Software • Cybersecurity • Automation
Remote
United States
600 Employees
179K-277K Annually

Tempus AI Logo Tempus AI

Customer Success Representative

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Remote or Hybrid
Chicago, IL, USA
3775 Employees
48K-55K Annually

Domino Data Lab Logo Domino Data Lab

Team Lead

Artificial Intelligence • Machine Learning
Easy Apply
Remote or Hybrid
US
200 Employees
175K-220K Annually

Domino Data Lab Logo Domino Data Lab

Staff Software Engineer

Artificial Intelligence • Machine Learning
Easy Apply
Remote or Hybrid
US
200 Employees
200K-250K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account