Technical Consultant

Reposted 16 Days Ago
Be an Early Applicant
2 Locations
Hybrid
Entry level
Artificial Intelligence • Analytics • Consulting • Semiconductor
The Role
Lead technical consulting and due diligence engagements for AI infrastructure and GPU cloud providers. Evaluate architecture, benchmark performance, reliability, scalability, storage, networking, and operational usability. Translate technical findings into client recommendations and investment insights, develop benchmarking and total-cost-of-ownership methodologies, author research reports, and build relationships across hyperscalers, AI labs, accelerator vendors, investors, and infrastructure companies.
Summary Generated by Built In

Employment Type: Full-Time
Work Setting: Onsite/Remote
Work Location: New York/San Francisco/Remote
Work Hours: Office Hours
Find out more here: https://semianalysis.com

About SemiAnalysis

SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. Our in-depth coverage spans the entire supply chain, from semiconductor fabrication processes to cutting-edge AI Models, software, and infrastructure. We are recognized as the leading authority on the semiconductor supply chain, with the highest concentration of industry experts within one team, and a deep-rooted passion for delving into the intricacies.
We’re a global team of over 50 analysts, each with extensive networks across the semiconductor supply chain and AI ecosystem, publishing industry shaping articles while participating in 40+ conferences annually.
Our newsletter reaches more than 200,000 subscribers worldwide, including senior management and c-suite leaders at the leading semiconductor and AI companies.
We also offer three core products:

  • Industry Models – we develop and publish industry models on accelerator shipments, datacentre demand and supply, GPU total cost of ownership, and more. We work with hyperscalers, neoclouds, many of the world’s largest hedge funds, and government agencies.

  • Core Research – our public equity markets product, geared towards financial investors, distils our deep technical research and knowledge into key insights on technology and product trends.

  • Consulting and Technical Due Diligence – We conduct custom research and project work to guide key strategic and investment decisions for the largest private equity funds, leading venture capital firms, companies across the AI ecosystem, and government agencies.

Position Overview
We are seeking a Technical Consultant to join our team working on ClusterMAX™, the industry standard GPU Cloud rating system. We are hiring at all experience levels with competitive compensation.

Responsibilities

  • Lead ClusterMAX™ consulting engagements, including technical due diligence projects related to neoclouds, AI accelerators, AI infrastructure, AI labs, and adjacent ecosystems.

  • Translate ClusterMAX™ benchmarking and testing insights into actionable recommendations and investment decisions for clients.

  • Contribute to the development of next-generation benchmarking methodologies, TCO analysis frameworks, and future ClusterMAX™ research initiatives.

  • Collaborate with executives, engineers, and technical teams across major neocloud providers, including Amazon Web Services, Microsoft Azure, Google Cloud, Oracle, CoreWeave, Nebius, Crusoe, Lambda, and Together.

  • Build and maintain relationships with AI accelerator manufacturers, OEMs, and ecosystem partners, including NVIDIA, AMD, Intel, Google, Amazon, Cerebras, Groq, Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Cisco.

  • Strengthen relationships with AI labs, investors, startups, and technical communities to better understand industry requirements and operational challenges.

  • Author detailed technical research reports evaluating architecture design, benchmark performance, reliability, scalability, and operational usability of neocloud and AI infrastructure providers.

  • Stay informed on emerging trends and technologies through participation in major industry conferences such as NeurIPS, MLSys, NVIDIA GTC, OCP, SC, and Hot Chips.

Requirements

  • Strong understanding of ML frameworks such as PyTorch and JAX.

  • Familiarity with GPU and TPU cluster environments running orchestration platforms such as Kubernetes or Slurm.

  • Understanding of distributed storage technologies including Weka, VAST, Lustre, and S3-based storage systems.

  • Knowledge of high-performance networking technologies such as InfiniBand and RoCEv2.

  • Understanding of ML systems benchmarking and performance testing tools, including GEMMs, nccl-tests, vLLM, sglang, fio, TorchTitan, Megatron, and related frameworks.

  • Experience working at a hyperscaler, neocloud provider, server OEM, AI accelerator company, or large-scale AI infrastructure environment is preferred.

  • Ability to work proactively and independently within a globally distributed team environment.

  • Strong analytical, technical communication, and problem-solving capabilities.

Growth Areas

  • Develop deep expertise in AI infrastructure, neocloud ecosystems, accelerators, and large-scale ML system benchmarking.

  • Gain exposure to technical due diligence and investment decision-making processes across frontier AI and semiconductor markets.

  • Build relationships with leading hyperscalers, AI labs, infrastructure startups, accelerator vendors, and institutional investors.

  • Contribute to industry-recognized benchmarking methodologies and technical research publications.

  • Expand technical knowledge across distributed systems, networking, storage, AI infrastructure, and performance optimization.

  • Work directly with globally recognized companies shaping the future of AI compute and infrastructure.

  • Increase visibility within the AI and semiconductor ecosystem through conferences, technical collaborations, and published research.

    SemiAnalysis LLC participates in the E-Verify program to confirm the employment eligibility of all newly hired employees. For more information, visit e-verify.gov.

    • E-Verify Poster: https://www.everify.gov/sites/default/files/everify/posters/EVerifyParticipationPoster.pdf

    • Right to Work Poster: https://www.justice.gov/crt/case-document/file/1133936/dl?inline=

Skills Required

  • Strong understanding of ML frameworks such as PyTorch and JAX
  • Familiarity with GPU and TPU cluster environments
  • Familiarity with Kubernetes or Slurm orchestration platforms
  • Understanding of distributed storage technologies including Weka, VAST, Lustre, and S3-based storage systems
  • Knowledge of InfiniBand and RoCEv2 networking technologies
  • Understanding of ML systems benchmarking and performance testing tools, including GEMMs, nccl-tests, vLLM, sglang, fio, TorchTitan, and Megatron
  • Experience at a hyperscaler, neocloud provider, server OEM, AI accelerator company, or large-scale AI infrastructure environment
  • Ability to work proactively and independently within a globally distributed team
  • Strong analytical, technical communication, and problem-solving capabilities
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Denver, CO
78 Employees
Year Founded: 2020

What We Do

SemiAnalysis is an independent research and analysis firm specializing in the semiconductor and artificial intelligence industries. The company provides deep technical and financial insights into the semiconductor supply chain, bridging the gap between business and technology. They offer specialized institutional products, including research models and consulting services, to help industry stakeholders make informed strategic decisions regarding AI infrastructure and semiconductor advancements.

Similar Jobs

Snap Inc. Logo Snap Inc.

Consultant

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
37-64 Hourly

Enverus Logo Enverus

Consultant

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
2 Locations
1800 Employees
76K-126K Annually

Enverus Logo Enverus

Consultant

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
3 Locations
1800 Employees
103K-120K Annually

Mastercard Logo Mastercard

Consultant

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Harrison, NY, USA
38800 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account