Staff Forward Deployed Engineer

Posted Yesterday
Be an Early Applicant
2 Locations
Remote
100K-500K Annually
Senior level
Hardware • Manufacturing
The Role
Build and operate AI inference deployments, write production code, debug full inference stack, collaborate with customers and engineering, and drive performance/observability improvements using Kubernetes, Helm, and LLM serving tools.
Summary Generated by Built In

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.

We’re looking for a Forward Deployed Engineer who’s excited to build with the engineers using the AI computers Tenstorrent makes. You will create continuity between customers, engineering, and AI inference service products. This is an engineering role first: you contribute production code, operate deployments, and you can explain a trade-off to customer leadership as clearly as to core engineering teams. This is a high-autonomy role with direct customer impact.

This role is remote, based out of North America, with preference near one of our main hubs: Santa Clara, CA; Austin, TX; or Toronto, ON.

We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting.


Who You Are

  • You understand how accelerator compute, memory, and networking topology constrain AI workloads, and don't treat hardware as a black box.
  • You're an early adopter of AI for your work from coding to building agentic workflows that multiply your impact.
  • You work directly with customers to understand their challenges and provide effective solutions.
  • You are comfortable debugging across the full inference stack: from failing requests, through the serving layer, down to OOMs or kernel dispatch if need be.
  • You bring feedback in the form of pull requests, reproducible code, benchmarks, and telemetry data.

What We Need

  • Strong software engineering skills with 5+ years of relevant technical experience (e.g. Applied Engineer, Machine Learning Engineer, MLOps Engineer, Platform Engineer, Infrastructure Engineer, Site Reliability Engineer, Field Application Engineer).
  • Experience turning ambiguous customer requirements or issues into verifiable acceptance criteria.
  • Kubernetes and Helm experience at multi-node, HPC, or AI cluster scale.
  • Experience with observability and infrastructure automation, e.g. Prometheus, Grafana, OpenTelemetry.
  • Experience with LLM inference serving engines and technologies, e.g. vLLM, SGLang, Mooncake, NIM, Dynamo, LMCache.

What You Will Learn

  • Where co-design of AI hardware and software translates into unique latency and throughput performance.
  • How to scale disaggregated inference services on Kubernetes while balancing performance, reliability, and tactical tradeoffs.
  • What makes enterprise AI deployments successful: from technical requirements through software delivery, cluster-scale validation, and production ownership.
  • Why customer insights from the field shape the best products.
  • How to build agentic workflows for asymmetric impact.

Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets. Experience, skills, education, background and location all impact the actual offer made.

Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.

This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology.  Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2).   These requirements apply to persons located in the U.S. and all countries outside the U.S.  As the position offered will have direct and/or indirect access to information, systems, or technologies subject to these laws, the offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency.  If employment is not possible due to U.S. export laws, any offer of employment will be rescinded.

Skills Required

  • Strong software engineering skills with 5+ years of relevant technical experience
  • Experience turning ambiguous customer requirements into verifiable acceptance criteria
  • Kubernetes and Helm experience at multi-node, HPC, or AI cluster scale
  • Experience with observability and infrastructure automation (Prometheus, Grafana, OpenTelemetry)
  • Experience with LLM inference serving engines and technologies (vLLM, SGLang, Mooncake, NIM, Dynamo, LMCache)
  • Comfort debugging across the full inference stack including kernel dispatch and memory/OOM issues
  • Eligibility to access U.S. export-controlled technology (citizenship/permanent residency or ability to obtain license)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto, ON
389 Employees
Year Founded: 2016

What We Do

Tenstorrent is a next-generation computing company that builds computers for AI. Headquartered in Toronto, Canada, with U.S. offices in Austin, Texas, and Silicon Valley, and global offices in Belgrade and Bangalore, Tenstorrent brings together experts in the field of computer architecture, ASIC design, advanced systems, and neural network compilers. Join us: www.tenstorrent.com/careers

Similar Jobs

Invisible Technologies Logo Invisible Technologies

Staff Software Engineer

Artificial Intelligence • Information Technology • Machine Learning • Professional Services • Software • Analytics • Consulting
Remote or Hybrid
9 Locations
370 Employees
210K-300K Annually

GC AI Logo GC AI

Member of Technical Staff, Forward Deployed Engineer

Artificial Intelligence • Legal Tech
Remote
2 Locations
100 Employees
165K-350K Annually
Remote
Canada
248 Employees
144K-253K Annually

Similar Companies Hiring

Fortune Brands Innovations Thumbnail
Manufacturing
Deerfield, IL
10000 Employees
Fairly Even Thumbnail
Hardware • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account