Product Manager - AI SW Infrastructure (AI Software Stack / Compiler / Platform) - US

Posted 3 Months Ago
Be an Early Applicant
Los Altos, CA, USA
In-Office
Senior level
Software
The Role
Lead product definition and delivery for an AI compiler and runtime platform: own compiler/toolchain roadmap, framework integrations (PyTorch, JAX, vLLM, Hugging Face Optimum), kernel optimizations, scale-out orchestration (SLURM, Ray, LMCache), and developer UX to enable optimized execution on Majestic's Ignite APU.
Summary Generated by Built In
Description


We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training.

Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us!


About the position



We are building the next generation of AI infrastructure-from custom silicon to the servers and systems that power the world's largest AI models. Our vertically integrated approach enables us to optimize every layer of the AI compute stack, delivering breakthrough performance, efficiency, and scalability.

We're looking for an experienced Product Manager who thrives at the intersection of the data center server grade hardware, systems engineering, and AI. In this role, you will define product strategy and execution for AI accelerator platforms, server architectures, and infrastructure products that enable true best-in-class inference on frontier-scale models.

You will work closely with silicon architects, hardware/systems engineers, software teams, AI researchers, operations, and executive leadership to bring complex products from concept


Responsibilities



  • Product Management / Operations: Own the infrastructure software layer: provisioning, telemetry, fleet management, firmware/BMC interfaces, observability, upgrade flows, reliability, security, and integration with the surrounding AI factory environment: storage, networking, management systems, orchestration, and data center operations.
  • Define software product feature set. Translate customer, engineering, and business requirements into detailed Product Requirements Documents (PRDs), technical specifications, and feature definitions. 
  • Own and develop detailed software schedules, milestone plans, and release timelines while managing dependencies across all engineering teams.
  • Product Strategy: 
  • Develop near, mid- and long-term product strategy and roadmap for next generation product spanning custom silicon, server platforms, and system-level architecture.
  • Develop near, mid- and long-term product strategy for modified product configurations and new product lines.  
  • Articulate product vision, success metrics and product positioning in the market . 
  • Prioritize features, functionality, and technical investments based on customer value, competitive landscape, engineering complexity, and business objectives.
  • Conduct product reviews, executive updates, and roadmap planning with senior leadership.
  • Work with the following teams:  
  • Architecture team to jointly analyze emerging AI workloads and translate them into future hardware and system capabilities. 
  • System engineers and ODM to optimize deployment, performance, power efficiency, cooling, networking, and total cost of ownership.
  • Software teams to ensure seamless integration across firmware, drivers, runtime software, orchestration, and AI frameworks.
  • Bizops to develop competitive analyses across AI infrastructure providers, hyperscalers, semiconductor companies, and emerging AI platform vendors.


Requirements


10+ years of product management experience across data center system-level or infrastructure software.

Familiarity with fleet and infrastructure software: Kubernetes, device plugins, orchestration, monitoring, and how cloud and data center operators provision and manage accelerators at scale.

Proven track record of managing highly technical, multidisciplinary infrastructure products from concept through scaled production.

Expertise in developing PRDs, technical specifications, and product roadmaps while driving prioritization, milestones, and release planning.

Strong analytical and communication skills, with the ability to make data-driven decisions and align executive stakeholders with deeply technical engineering teams.


Preferred qualifications


  • M.S. or Ph.D. in Computer Science, Electrical Engineering, Computer Engineering, Artificial Intelligence, Machine Learning, Applied Physics, or a related technical discipline.
  • MBA or equivalent in product strategy or technology commercialization.
  • Product management experience at large hyperscaler/neo-clouds, frontier AI labs, AI HW/server companies, or similar organizations developing large-scale AI systems.We seek smart, curious, self-driven individuals who enjoy creative problem-solving and continuous learning. Even if you don't meet all requirements, we'd love to hear from you if you have the mindset to tackle complex challenges.


Majestic Labs is an equal opportunity employer deeply committed to diversity of background and thought. If you are ready to dare greatly, learn from mistakes, engage in vigorous debates, and help create a step-function shift in human technical capability, we want to meet you!

Skills Required

  • Master of Science (M.Sc.) or Ph.D. in Computer Science, Electrical Engineering, Mathematics, or Physics
  • 5–8+ years product management or software systems engineering experience shipping compiler technologies, deep learning frameworks, or developer platform tools
  • Deep understanding of CUDA, Triton, high-performance C++ DSP libraries, and multi-threaded parallel computation paradigms
  • Familiarity with HPC scale-out infrastructures, distributed memory architectures, and high-performance networking protocols
  • Prior experience at accelerated software, cloud, or startup organizations building complex AI compute systems (e.g., NVIDIA, Meta, Google, AWS, SambaNova, Cerebras, Groq, Lightning AI)
  • MBA or equivalent experience in technology commercialization or product strategy
  • Active contributions to open-source AI infrastructure projects, compilers (MLIR/LLVM), or performance optimization libraries
  • Direct experience inside a frontier AI lab or foundation model organization (OpenAI, Anthropic, xAI, Google DeepMind) developing large-scale distributed systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
55 Employees
Year Founded: 2023

What We Do

Majestic Labs is reimagining AI infrastructure for the world’s most demanding workloads. Today, organizations are forced to overprovision expensive compute just to access the required memory their models need. We took a fundamentally different approach by pairing a massive amount of compute with 1000x the memory to create game changing improvements in performance, power and deployment efficiency. Our customers can literally replace racks of traditional AI infrastructure with a single Majestic server.

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Vacaville, CA, USA
16000 Employees
15-20 Hourly

Boeing Logo Boeing

DSP Algorithms Engineer (Associate or Mid-Level)

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
99K-162K Annually

Boeing Logo Boeing

Systems Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
120K-162K Annually

Boeing Logo Boeing

Systems Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
99K-162K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account