Staff Engineer

litellm· Engineering
Apply Now ↗
📍 San FranciscoFullTime💰 USD 240K–270K

About this role

Staff Software Engineer, Product Quality

LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Staff Software Engineer to own product quality across our testing, CI, and release systems.

About The Role

You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.

Responsibilities

  • Own product quality end to end and drive regressions toward zero

  • Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes

  • Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship

  • Build canary and synthetic traffic detection to catch upstream provider drift before customers do

  • Own release channels so we ship daily at the edge while enterprise stays stable

  • Do real root cause analysis and turn every escaped defect into a permanent test

  • Raise the engineering bar through code and review, not through process documents

What We're Looking For

  • Experience at a startup (Seed to Series D) with a willingness to wear multiple hats

  • Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution

  • Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms

  • Opinions about what makes a test suite worth trusting

  • Track record of raising quality on a team without becoming the bottleneck

  • Open source contributions on GitHub or similar

Why Join LiteLLM?

  • Own the quality mandate at a high-impact technical company

  • Deep technical ownership, in the codebase, not in meetings

  • Fast-paced environment with real scale behind it

  • Competitive salary and benefits

About LiteLLM

LiteLLM is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.

Ready to own quality at LiteLLM? Apply now!

Frequently Asked Questions

What is the salary for the Staff Engineer role at litellm?
The listed salary for this Staff Engineer position at litellm is USD 240K–270K. This is an FullTime role.
Where is the Staff Engineer position at litellm located?
This Staff Engineer role at litellm is based in San Francisco. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Staff Engineer role at litellm full-time or part-time?
This is listed as a FullTime position. It is posted as a Staff Engineer role in the Engineering department at litellm.
Which team or department does the Staff Engineer at litellm belong to?
This Staff Engineer position is part of the Engineering department at litellm. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Staff Engineer position at litellm?
Click the "Apply Now" button on this page. You will be redirected to litellm's official application portal hosted on ashby where you can submit your application directly.
When was the Staff Engineer job at litellm posted?
This Staff Engineer position at litellm was posted on Jul 25, 2026. Apply as soon as possible — early applications are often reviewed first.
Staff Engineer
litellm · 💰 USD 240K–270K
Apply for this role ↗

You'll be redirected to litellm's official application page on Ashby ATS.