Software Engineer, Backend Infrastructure

About Us:

Here at Fireworks, we’re building the future of generative AI infrastructure. Fireworks offers the generative AI platform with the highest-quality models and the fastest, most scalable inference. We’ve been independently benchmarked to have the fastest LLM inference and have been getting great traction with innovative research projects, like our own function calling and multi-modal models. Fireworks is funded by top investors, like Benchmark and Sequoia, and we’re an ambitious, fun team composed primarily of veterans from Pytorch and Google Vertex AI.

The Role:

As a Backend Software Engineer, you’ll be responsible for designing and developing the core backend systems that power Fireworks AI’s high-performance generative AI platform. Your work will focus on ensuring efficiency, scalability, and stability in handling AI workloads.

Key Responsibilities:

• Design and build core backend software components, ensuring efficiency, scalability, and stability of system resources

• Conduct design/code reviews and collaborate with cross-functional teams

• Continuously analyze and optimize infrastructure efficiency for AI workloads (compute, storage, networking)

Minimum qualifications:

• Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

• 3+ years experience working in ML infra (PyTorch, Vertex AI, Sagemaker, etc.)

• Experience building, scaling, and optimizing enterprise-grade Machine Learning systems

Preferred qualifications:

• Experience in AI or large scale infrastructure

• Master’s or PhD degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

Why Fireworks AI?

• Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.

• Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.

• Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.

• Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.