AI Inference Support Engineer

Reposted 7 Days Ago
Be an Early Applicant
4 Locations
In-Office
Mid level
Artificial Intelligence
The Role
As an AI Inference Support Engineer, you'll troubleshoot customer issues in AI inference, manage tickets, analyze performance metrics, and collaborate with engineering teams.
Summary Generated by Built In

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.  

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About The Role

Join Cerebras’ new Global Support organization to help customers run production-grade AI inference. You’ll troubleshoot issues across model serving, deployment, and observability; resolve customer tickets; and partner with Engineering to improve the reliability, performance, and usability of our inference platform. 

Responsibilities
  • Own inbound tickets for inference issues (availability, latency/throughput, correctness, model loading, etc.). 
  • Triage, reproduce, and debug across the stack: APIs/SDKs, model serving layers (e.g., vLLM), networking, etc. 
  • Analyze logs/metrics/traces (e.g., Prometheus/Grafana/ELK) to drive fast resolution and clear RCAs. 
  • Create and maintain high-quality runbooks, knowledge base articles, and “getting unstuck” guides. 
  • Collaborate with Product/Eng to escalate defects, validate fixes, and influence roadmap via aggregated support insights. 
  • Participate in follow-the-sun on-call rotations for P1/P2 incidents with defined SLAs. 
  • Proactively identify pain points in both our solutions and those of our customers. 
  • Advocate for customer needs internally, helping prioritize fixes, features, and reliability improvements. 
Skills & Qualifications
  • 4–6 years in technical support, SRE, or solutions engineering for distributed systems or ML/AI products. 
  • Strong Linux fundamentals; confident with shell, systemd, containers (Docker), basic networking (TLS, DNS, HTTP/2, gRPC), and debugging with logs/metrics. 
  • Proficiency in at least one scripting language (Python preferred) for repros, tooling, and log parsing. 
  • Familiarity with modern LLM inference concepts: token streaming, batching, KV cache, etc. 
  • Excellent customer communication: drive clarity from ambiguous reports, write crisp updates, and set accurate expectations. 
Assets
  • Exposure to one or more serving stacks (e.g. vLLM) and OpenAI-compatible APIs. 
  • Observability practice (Prometheus, Grafana, Elk) and basic performance testing. 
  • Ticketing/ITSM (e.g., Jira/ServiceNow/Zendesk), incident response, and SLA/SLO workflows. 
  • Experience with GPUs/accelerators and performance tuning (throughput vs. latency trade-offs, batching/concurrency tuning). 
  • Demonstrate humility, collaboration, and a commitment to continuous learning to support team and customer success. 
Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection  point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.
  2. Publish and open source their cutting-edge AI research.
  3. Work on one of the fastest AI supercomputers in the world.
  4. Enjoy job stability with startup vitality.
  5. Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2025.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Top Skills

Docker
Elk
Grafana
Linux
Prometheus
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sunnyvale, CA
402 Employees
Year Founded: 2016

What We Do

Cerebras Systems is a team of pioneering computer architects, computer scientists, deep learning researchers, functional business experts and engineers of all types. We have come together to build a new class of computer to accelerate artificial intelligence work by three orders of magnitude beyond the current state of the art.

The CS-2 is the fastest AI computer in existence. It contains a collection of industry firsts, including the Cerebras Wafer Scale Engine (WSE-2). The WSE-2 is the largest chip ever built. It contains 2.6 trillion transistors and covers more than 46,225 square millimeters of silicon. The largest graphics processor on the market has 54 billion transistors and covers 815 square millimeters. In artificial intelligence work, large chips process information more quickly producing answers in less time. As a result, neural networks that in the past took months to train, can now train in minutes on the Cerebras CS-2 powered by the WSE-2.

Join us: https://cerebras.net/careers/

Similar Jobs

Magna International Logo Magna International

Program Manager

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Yokohama, Kanagawa, JPN
171000 Employees

Mastercard Logo Mastercard

Expression of Interest: Manager, Market Delivery

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Tokyo, JPN
35300 Employees

Cloudflare Logo Cloudflare

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Tokyo, JPN
4400 Employees

Dynatrace Logo Dynatrace

Solutions Engineer

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Hybrid
Tokyo, JPN
5200 Employees

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account