LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Staff Software Engineer to own product quality across our testing, CI, and release systems.
About The RoleYou will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
ResponsibilitiesOwn product quality end to end and drive regressions toward zero
Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
Build canary and synthetic traffic detection to catch upstream provider drift before customers do
Own release channels so we ship daily at the edge while enterprise stays stable
Do real root cause analysis and turn every escaped defect into a permanent test
Raise the engineering bar through code and review, not through process documents
Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution
Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms
Opinions about what makes a test suite worth trusting
Track record of raising quality on a team without becoming the bottleneck
Open source contributions on GitHub or similar
Own the quality mandate at a high-impact technical company
Deep technical ownership, in the codebase, not in meetings
Fast-paced environment with real scale behind it
Competitive salary and benefits
LiteLLM is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to own quality at LiteLLM? Apply now!
Skills Required
- Experience at a startup (Seed to Series D) and willingness to wear multiple hats
- Built test or release infrastructure for systems with large external integration surfaces, or maintained CI for heavily contributed OSS projects
- Strong debugging depth; ability to find root causes in unfamiliar codebases
- Opinions about what makes a test suite trustworthy
- Proven track record of raising quality without becoming the bottleneck
- Open source contributions on GitHub or similar
What We Do
LiteLLM is an open-source AI Gateway that provides a unified interface to access over 100 LLM providers, simplifying model access, spend tracking, and fallbacks.
