Jobs at LiteLLM

Build and maintain a provider-agnostic LLM interoperability layer: transform OpenAI/Anthropic spec calls to other provider formats, implement session management, support provider features (skills, batching), and improve developer experience via the Python SDK. Work closely with founders and engage with users to ship production features.

Own and manage the support queue for LiteLLM, diagnose and reproduce customer issues, drive root-cause fixes, submit pull requests for bug fixes, and represent customers technically to engineering to ensure product success.

Lead and manage an engineering team building an open-source AI gateway: own delivery, quality, release health, metrics, incident management, hiring, and enterprise escalations. Drive technical roadmap (including a Rust migration), architect consistent code patterns, and support open-source community adoption.

Lead LiteLLM’s go-to-market strategy, revenue growth, enterprise sales, and sales-team development. Build and scale a high-performing B2B software sales organization, establish pipeline and forecasting processes, close major customer deals, and develop market positioning with product, engineering, and marketing teams. The role requires deep understanding of AI infrastructure, developer tools, technical buyers, open-source communities, and early-stage startup growth.

Lead application and supply-chain security for LiteLLM. Proactively hunt, identify, and remediate vulnerabilities across the platform and CI/CD, ensure secure release processes, collaborate with engineering teams, and continuously improve offensive security posture.

Own product quality across provider integrations by building conformance tests, CI/release tooling, canary/synthetic detection, and release channels. Drive regressions toward zero, perform root cause analysis, convert escapes into permanent tests, and raise engineering standards through code and reviews.

Own the support queue, diagnose and reproduce customer issues, drive customers to success, submit pull requests for bug fixes, and act as the technical voice of the customer to engineering.

Own the customer support queue, diagnose and reproduce issues in customer environments, drive root-cause fixes, submit pull requests for bug fixes, and represent customers technically to engineering to ensure their success with LiteLLM.

Own the support queue, diagnose and reproduce customer issues, drive to root causes, submit bug-fix PRs, and act as the technical voice of customers to engineering to ensure product success.

Lead and own the end-to-end migration of LiteLLM from Python to Rust: plan architecture with the CTO, restructure the codebase, execute a stability-first gradual rollout, and drive large-scale performance improvements for a high-volume LLM gateway.

The Senior Backend Engineer will design and scale backend guardrails, enhance observability tools, ensure error transparency, and maintain compliance for high-volume traffic systems.

Manage LiteLLM's top accounts as the technical lead, regularly communicate with developer customers, resolve issues and feature requests, prevent churn, drive product adoption and surface roadmap opportunities to product teams.

Own and drive success for LiteLLM's top accounts as the technical point of contact. Proactively prevent churn, unblock customer issues, assist with rollouts, surface product gaps to engineering, and maintain regular customer communication to increase usage and ensure renewals.

Work with founders to define and build LiteLLM's second product: talk to customers, design solutions, prototype, and ship production features. Build backend APIs and services with Python and FastAPI, improve developer experiences across API, dashboard, and CLI, and own major product areas end-to-end from concept to production.

Own and triage the support queue for LiteLLM, diagnose and reproduce customer issues, drive root-cause fixes, submit pull requests for bugs, and represent customer needs to engineering.

Founding Developer Relations is a hands-on technical IC who builds runnable demos, sample apps, tutorials, and launch materials; engages and supports the developer community; turns feedback into product improvements; and defines the DevRel strategy and launch processes.