Senior Performance Engineer, Inference

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office or Remote
Senior level
Artificial Intelligence • Hardware • Software • Semiconductor
The Role
Build and maintain reproducible inference benchmarks (tokens/sec, time-to-first-token, latency, TCO), track GPU/kernel optimizations and quantization impacts, maintain competitive pricing models across inference providers, produce actionable competitive analyses for Sales and Product, and represent Cerebras in third-party benchmarking and industry monitoring.
Summary Generated by Built In

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

We are hiring a Senior Performance Engineer to join our Product team. You are an expert on state-of-the-art inference performance and will serve as our resident expert on how Cerebras stacks up against alternative inference providers on both price and performance. This role sits at the intersection of performance benchmarking from first principles and competitive intelligence. The role has two core pillars:

  1. Performance Benchmarking
    You will build, run, and maintain reproducible benchmarks that measure Cerebras inference performance for real customer workloads. This includes metrics like tokens per second, time to first token, latency under concurrency, and total cost of ownership (TCO). 

  2. Competitive Pricing Intelligence
    You will build and maintain a living model of competitor pricing across the AI inference landscape, including cloud providers, custom silicon vendors, and inference API platforms. You will work directly with our Sales and Product teams to translate this intelligence into pricing recommendations for enterprise contracts, ensuring Cerebras offers a compelling value proposition for every customer.

This role requires deep, hands-on fluency with open-source inference stacks (vLLM, SGLang, TensorRT-LLM), GPU kernel-level optimization toolchains (CUDA, Triton), and an intuitive understanding of how transformer architecture decisions—attention mechanisms, model sizing, quantization, KV-cache strategies—interact with the realities of GPU memory hierarchies and compute budgets. 

Responsibilities
  • Design standardized benchmark suites for inference workloads (code generation, summarization, multi-turn conversation, agentic tool use) that enable fair, reproducible comparisons. 

  • Stay current with GPU optimization communities (CUDA, Triton, TensorRT) and evaluate how new kernel fusions, flash-attention variants, and quantization techniques shift performance ceilings. 

  • Build and continuously update a competitive pricing model covering token-based pricing, throughput-based pricing, and enterprise contract structures across major inference providers. 

  • Monitor industry announcements, pricing changes, and new product launches. Synthesize findings into actionable briefs for the Sales and Product teams. 

  • Partner with Sales to build deal-specific competitive analyses showing total cost of ownership and performance advantages for enterprise prospects. 

  • Collaborate with Product and Engineering to identify where competitors are closing gaps or where Cerebras has underappreciated advantages. 

  • Track third-party benchmarking sources (Artificial Analysis, InferenceX) and ensure Cerebras is well-represented and accurately measured. 

Skills & Qualifications

Required 

  • Deep practical experience with state-of-the-art open-source inference frameworks like vLLM, SGLang, or TensorRT-LLM. 

  • 5+ years of experience in ML systems, ML research engineering, or high-performance computing. 

  • Strong understanding of LLM inference economics: tokens, throughput, latency, batch sizes, precision trade-offs, and how these translate to customer cost. 

  • Strong understanding of transformer model architecture internals such as attention mechanisms (MHA, MQA,GQA, MLA, DSA, MHA) and KV-cache management, and how each affects memory and compute profiles. 

  • Self-directed and resourceful.  

Preferred 

  • Background in ML research (publications or significant open-source contributions) with a systems or efficiency focus. 

  • Contributions to open-source inference or kernel optimization projects. 

  • Excellent communication skills. You will collaborate with executives, write for engineers, and create materials for sales leaders. 

 

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.

  2. Publish and open source their cutting-edge AI research.

  3. Work on one of the fastest AI supercomputers in the world.

  4. Enjoy job stability with startup vitality.

  5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Skills Required

  • Deep practical experience with open-source inference frameworks (vLLM, SGLang, TensorRT-LLM).
  • Hands-on experience with GPU kernel-level optimization toolchains (CUDA, Triton) and TensorRT.
  • 5+ years in ML systems, ML research engineering, or high-performance computing.
  • Strong understanding of LLM inference economics: tokens, throughput, latency, batch sizes, precision trade-offs, and customer cost translation.
  • Deep knowledge of transformer internals (attention variants) and KV-cache management and their memory/compute effects.
  • Self-directed and resourceful work style.
  • Background in ML research (publications or significant open-source contributions) with systems or efficiency focus.
  • Contributions to open-source inference or kernel optimization projects.
  • Excellent communication skills for collaborating with executives, engineers, and sales leaders.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
774 Employees
Year Founded: 2015

What We Do

Cerebras Systems develops wafer-scale semiconductor hardware, AI supercomputers, and software/cloud services for training and inference. Its CS-2 and CS-3 systems help organizations build on-premise AI supercomputers, while pay-as-you-go cloud offerings provide developers and enterprises access to its computing platform. The company focuses on making AI training and inference faster and easier for diverse research and production workloads at scale worldwide.

Similar Jobs

Compa Logo Compa

Senior Software Engineer

Artificial Intelligence • HR Tech • Software • Business Intelligence
Remote or Hybrid
4 Locations
75 Employees
165K-220K Annually

CrowdStrike Logo CrowdStrike

Growth Development Representative (Hybrid)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
Office, Machaze, Manica, MOZ
11000 Employees

Mondelēz International Logo Mondelēz International

Global Consumer Data Platform Product Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
3 Locations
90000 Employees

Auror Logo Auror

Chief Of Staff

Artificial Intelligence • Big Data • Retail • Security • Social Impact • Software • Business Intelligence
Remote or Hybrid
Office, Machaze, Manica, MOZ
212 Employees
200K-230K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account