AI Product Engineer

Posted 4 Hours Ago
Be an Early Applicant
3 Locations
In-Office or Remote
200K-350K Annually
Mid level
Software • Generative AI
The Role
Build and own developer-facing product features for an LLM inference and fine-tuning platform, spanning frontend (console, playground), backend services, APIs, deployment, billing, and instrumentation. Ship end-to-end features, collaborate with cross-functional teams, and iterate rapidly based on usage data.
Summary Generated by Built In
About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

About the Role

We're looking for a product-minded engineer to join Fireworks as a Member of Technical Staff on our Product Engineering team. You'll build the product surfaces that developers and enterprises interact with every day — from the inference API and developer console to fine-tuning workflows, model deployment, billing, and new products like Fire Pass.

Fireworks owns the full stack: training, fine-tuning (SFT and RFT at frontier scale), serverless and dedicated inference, multi-LoRA serving, and agentic orchestration — all on infrastructure we built from scratch. Product Engineering sits on top of that stack and turns it into things developers and Enterprises can actually use. You'll work across the surfaces where our platform meets its users: the APIs they call, the console they configure deployments in, the fine-tuning jobs they launch, the billing systems that meter their usage, and the agentic tooling they build with.

This is a high-autonomy IC role. You'll own features end-to-end — from understanding the problem, to designing the solution, to shipping it, to watching how developers actually use it. We're a small team building a platform that processes trillions of tokens daily, so the work you do will be used immediately and at enormous scale.

 Key Responsibilities
  • Design, build, and ship product features across the Fireworks platform — including the developer console, API surfaces, model playground, fine-tuning workflows, deployment management, and billing
  • Own features end-to-end: scope the problem, build the solution, ship it, instrument it, and iterate based on real usage
  • Build and improve the developer experience for Fireworks' core product capabilities — serverless and on-demand inference, supervised and reinforcement fine-tuning, multi-LoRA serving, and agentic orchestration
  • Work across the full stack — frontend (React/TypeScript), backend services (Python, Go), APIs, and data layers — to deliver polished, production-quality product surfaces
  • Build for products that are evolving rapidly: new model types, new serving paths (standard, priority, fast), new consumption models like Fire Pass, and new capabilities like multi-agent harness tooling
  • Partner closely with Infrastructure, Applied Research, Growth, Data and Design to translate platform capabilities into intuitive developer-facing products
  • Instrument and monitor the systems you build, using data to understand how developers use the platform and where friction exists
  • Move fast and make pragmatic trade-offs — the pace of AI infrastructure demands shipping early, learning quickly, and iterating with conviction
 Minimum Qualifications
  • 3 years of experience as a software engineer, with meaningful time spent building user-facing products
  • Strong full stack development skills — comfortable working across frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases
  • Experience building and shipping developer-facing products: APIs, dashboards, consoles, CLIs, or developer tools
  • Track record of owning features end-to-end — you're as comfortable scoping a problem as you are deploying the fix
  • Strong product instincts — you think about the developer experience, not just the implementation
  • Demonstrated ability to operate at high velocity with extreme ownership: you ship fast, make pragmatic trade-offs, and don't wait to be told what to build
 Preferred Qualifications
  • Experience building products on top of complex infrastructure — inference platforms, cloud services, data platforms, or ML tooling
  • Experience building for deeply technical users (developers, ML engineers, platform teams) where the product surface is an API as much as a UI
  • Comfort working in a fast-moving, founder-led environment where the product is evolving week to week and the map is being drawn as you go
  • You build with AI tools daily — you use them to accelerate your own work and have strong intuition for what great AI developer experience looks like from the inside

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$200,000$350,000 USD
Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Skills Required

  • 3 years of experience as a software engineer
  • Strong full stack development skills: frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases
  • Experience building and shipping developer-facing products (APIs, dashboards, consoles, CLIs, or developer tools)
  • Track record of owning features end-to-end (scope, build, ship, monitor, iterate)
  • Strong product instincts focused on developer experience
  • Demonstrated ability to operate at high velocity with extreme ownership
  • Experience building products on top of complex infrastructure (inference platforms, cloud services, data platforms, or ML tooling)
  • Experience building for deeply technical users (developers, ML engineers, platform teams)
  • Comfort working in a fast-moving, founder-led environment
  • Regular use of AI tools and strong intuition for AI developer experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redwood City, CA
63 Employees
Year Founded: 2022

What We Do

Fireworks.ai offers generative AI platform as a service. We optimize for rapid product iteration building on top of gen AI as well as minimizing cost to serve. https://fireworks.ai/careers

Similar Jobs

In-Office or Remote
San Francisco, CA, USA
100 Employees
200K-250K Annually

ClickHouse Logo ClickHouse

Product Engineer

Database • Analytics
Remote
United States
91 Employees
130K-208K Annually
Remote
United States
134 Employees
150K-210K Annually
Remote
United States
134 Employees
130K-175K Annually

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account