Senior Modeling Architect, Performance Benchmarking

Posted 5 Days Ago
Be an Early Applicant
2 Locations
In-Office
210K-250K Annually
Senior level
Artificial Intelligence • Machine Learning • Semiconductor
We’re building the first programmable light-speed computer.
The Role
Own performance and energy benchmarking for an optical AI inference accelerator. Build reproducible benchmarks across analytical models, architecture models, RTL simulation, and competitor GPUs. Bring up workloads from Hugging Face, PyTorch, papers, and inference stacks; measure latency, throughput, power, and energy; analyze bottlenecks; operate cloud or lab environments; and document configurations, logs, assumptions, and discrepancies.
Summary Generated by Built In
About Neurophos

The demand for new data centers and AI compute is rapidly outpacing the planet's energy capacity. Digital solutions are hitting a power wall as we approach the physical limits of traditional silicon. Conquering this bottleneck means rethinking the fundamental architecture of inference compute. The industry's current path can't meet the need, so we're taking a different approach.

Instead of traditional electronic circuits, we use silicon photonics and an active, programmable metasurface to perform matrix multiplications at the speed of light. Our optical cells are 10,000x smaller than traditional photonic components, enabling unprecedented density. By using photonics instead of electricity, our chips become more efficient as they scale. This architecture will deliver up to 100 times the energy efficiency of existing solutions while significantly improving performance for large-scale AI inference.

We’ve assembled a world-class team of industry veterans and recently raised a $110M Series A led by Gates Frontier. Participants include M12 (Microsoft’s Venture Fund), Carbon Direct Capital, Aramco Ventures, Bosch Ventures, Tectonic Ventures, Space Capital, and others.

Join us and shape the future of computing!

Location: Austin, TX or Sunnyvale, CA. Full-time onsite position.

Reports To: Sr. Director of Modeling

FLSA Status: Exempt

Position Overview

We are seeking a performance engineer to own the benchmarking numbers behind the T100 optical inference accelerator. Architecture and product decisions here are made on measured performance and energy, and this role produces those figures for the same workloads at every level of fidelity we use: roofline and limiter analysis, architecture performance models, in-house RTL simulation, and measured runs on competing GPUs and accelerators.

You will join the Architecture and Modeling team, set the measurement methodology, and keep it current as models, software stacks, drivers, and hardware generations turn over. Every result ships with the harness, config, plots, logs, and assumptions behind it, so anyone can rerun it and see how the number was reached.

Key Responsibilities
  • Own the performance and energy metrics that architecture, product, and leadership rely on, and keep them consistent across modeling fidelities and measured hardware.

  • Produce numbers for the same workloads across all fidelities we use internally: roofline and limiter models, architecture performance models, in-house RTL simulation, and measured competitor hardware. Work with the modeling team to keep the simulated and measured workload sets aligned.

  • Hold workload definitions constant across fidelities, including model or application, sequence length, batch, precision, prefill versus decode, and tensor, pipeline, and sequence parallelism.

  • Bring up inference workloads from Hugging Face, PyTorch, published papers, and vendor stacks such as vLLM, SGLang, TensorRT-LLM, and Triton Inference Server. These include dense and Mixture-of-Experts (MoE) transformers, attention and KV-cache reduction strategies, and hybrid/SSM models, as well as retrieval, speech, vision, and recommendation workloads that map onto the accelerator.

  • Measure competing GPUs and accelerators end-to-end, owning the cloud or lab account, image, drivers, and run recipe.

  • Report time to first token (TTFT), inter-token latency (ITL), tokens per second, tokens per second per watt, and energy, using nvidia-smi, DCGM, power capping, or equivalent instrumentation.

  • Document where RTL simulation, the performance model, and measured competitor results disagree, and attach the configs and logs behind each.

  • Maintain a reviewed internal benchmark suite. Keep internal-only results clearly separate from anything cleared for customer or public use, and route external claims through the designated approver before they ship.

Qualifications
  • BS or MS in Computer Engineering, Electrical Engineering, Computer Science, or equivalent practical experience.

  • 5+ years of experience in GPU performance engineering, accelerator benchmarking, HPC performance measurement, or ML systems measurement.

  • Track record of building or operating benchmark harnesses that produced measured results on real GPUs or accelerators, including turning a Hugging Face model card, paper, or application description into a runnable benchmark.

  • Hands-on experience with roofline analysis, limiter analysis, or analytical performance modeling.

  • GPU performance analysis with NVIDIA Nsight Systems and Nsight Compute, or an equivalent profiler, covering HBM-bound versus compute-bound analysis, precision (FP16, BF16, FP8, INT8), and batching.

  • Working knowledge of LLM inference stacks such as Hugging Face, vLLM, SGLang, or TensorRT-LLM, including prefill versus decode, continuous batching, and MoE.

  • Proficiency in Python for harnesses, parsing, and plots, and comfort working in Linux.

  • Cloud GPU operations on AWS, GCP, or Azure, including containers, instance types, drivers, quotas, and cost.

Preferred Skills
  • Experience correlating a performance model or RTL/Verilator simulation against measured silicon or GPUs.

  • GPU kernel work in CUDA, CUTLASS, or Triton, or familiarity with PyTorch internals.

  • Familiarity with current inference-serving internals such as PagedAttention, FlashAttention, speculative decoding, and disaggregated prefill.

  • Distributed inference experience covering collectives, all-reduce, NCCL, NVLink, and InfiniBand, or work with MLPerf or production inference benchmarking pipelines.

  • Background at a hyperscaler, GPU vendor, accelerator company, or inference lab.

What We Offer

This is an opportunity to play a pivotal role in an innovative startup redefining the future of AI hardware. Work on game-changing technology at the intersection of photonics and AI as part of a collaborative, brilliant team. You’ll contribute to a platform that redefines computational performance and accelerates the future of artificial intelligence. Come help us bring this transformative technology to the world.

 
Benefits

Join a team that invests in your future and your well-being. At Neurophos, we offer:

  • 100% coverage of base health plan premiums for you and your dependents, plus HSA contributions.

  • Unlimited PTO. No rigid vacation banks, just a focus on delivery.

  • 401(k) matching and stock option opportunities to ensure our success is your success.

  • Full suite of voluntary benefits, including Dental, Vision, Life, Hospital, Critical Illness, and Accident insurance.

  • Personalized Benefits. Choose the plans that fit your life and take the cash back for those that don’t.

Skills Required

  • BS or MS in Computer Engineering, Electrical Engineering, Computer Science, or equivalent practical experience
  • 5+ years of experience in GPU performance engineering, accelerator benchmarking, HPC performance measurement, or ML systems measurement
  • Experience building or operating benchmark harnesses producing measured results on real GPUs or accelerators
  • Experience converting a Hugging Face model card, research paper, or application description into a runnable benchmark
  • Hands-on experience with roofline analysis, limiter analysis, or analytical performance modeling
  • GPU performance analysis using NVIDIA Nsight Systems, NVIDIA Nsight Compute, or an equivalent profiler
  • Experience analyzing HBM-bound versus compute-bound workloads, precision, and batching
  • Working knowledge of LLM inference stacks including Hugging Face, vLLM, SGLang, or TensorRT-LLM
  • Knowledge of prefill versus decode, continuous batching, and Mixture-of-Experts models
  • Proficiency in Python for benchmark harnesses, parsing, and plots
  • Comfort working in Linux
  • Cloud GPU operations on AWS, GCP, or Azure, including containers, instance types, drivers, quotas, and cost
  • Experience correlating performance models or RTL/Verilator simulations against measured silicon or GPUs
  • GPU kernel experience with CUDA, CUTLASS, or Triton, or familiarity with PyTorch internals
  • Familiarity with PagedAttention, FlashAttention, speculative decoding, and disaggregated prefill
  • Distributed inference experience with collectives, all-reduce, NCCL, NVLink, and InfiniBand
  • Experience with MLPerf or production inference benchmarking pipelines
  • Background at a hyperscaler, GPU vendor, accelerator company, or inference lab

Neurophos Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Neurophos and has not been reviewed or approved by Neurophos.

  • Healthcare Strength Job postings indicate the company covers 100% of base health plan premiums for employees and dependents and contributes to HSAs. Listings also reference dental, vision, and other voluntary coverages.
  • Leave & Time Off Breadth Unlimited PTO is advertised with an emphasis on delivery rather than accruals. Notes in postings suggest clarifying typical usage and any minimums.
  • Retirement Support A 401(k) with employer matching is listed alongside stock option opportunities. This pairing signals structured retirement support in addition to equity participation.

Neurophos Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, Texas
50 Employees
Year Founded: 2020

What We Do

Neurophos is an Austin-based semiconductor company developing high-performance, energy-efficient photonic AI inference chips. Instead of traditional electronic circuits, we use silicon photonics and an active, programmable metasurface to perform matrix multiplications at the speed of light. Our optical cells are 10,000x smaller than traditional photonic components, enabling unprecedented density for an optical system. As AI adoption accelerates, data centers face significant power and scalability challenges. Traditional solutions are struggling to keep up, leading to rapidly rising energy consumption and costs. We’re solving both problems with an OPU that integrates over one million micron-scale optical processing components on a single chip. This architecture will deliver up to 100 times the energy efficiency of existing solutions while significantly improving large-scale AI inference performance. We’ve assembled a world-class team of industry veterans and recently raised a $110M Series A led by Gates Frontier. Participants include M12 (Microsoft’s Venture Fund), Carbon Direct Capital, Aramco Ventures, Bosch Ventures, Tectonic Ventures, Space Capital, and others. We have also been recognized on the EE Times Silicon 100 list for several consecutive years. Join us and shape the future of optical computing!

Why Work With Us

This is an opportunity to work on a game-changing technology at the intersection of photonics and AI. You’ll contribute to a platform that redefines computational performance and accelerates the future of artificial intelligence.

Similar Jobs

PNC Bank Logo PNC Bank

Technology Solution Center Analyst Lead

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
41K-83K Annually

PNC Bank Logo PNC Bank

Software Engineer

Machine Learning • Payments • Security • Software • Financial Services
Hybrid
Farmers Branch, TX, USA
55000 Employees

PNC Bank Logo PNC Bank

Software Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees

Shield AI Logo Shield AI

Lead Program Finance (R5875)

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office
Dallas, TX, USA
110K-170K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account