LiteLLM
Managing API keys and access to multiple AI providers/models via a local proxy, Integrating natively into existing software ecosystems like OpenClaw
It acts as a free, self-hosted router that unifies access to many LLM APIs with minimal extra setup.
Related Tools
FIRST-HAND READS
What people reported, in their own words. Every line links to where it was said.
“My gateway (litellm) has my local models with a fallback to the same model on openrouter. Best of both worlds.”
POSITIVE · features · Hacker News · 2026-07-09
“LiteLLM has the most mature, and broadest range of unified api's x providers”
POSITIVE · features · Hacker News · 2026-06-23
“the ADK's LiteLLM connector doesn't natively manage the Google-signed ID token lifecycle”
NEGATIVE · features · Hacker News · 2026-05-29
“you can do all of what you mentioned and more with a LiteLLM instance”
POSITIVE · features · Hacker News · 2026-04-09
“Pretty similar to litellm[proxy], but supports the Responses API and also some re-write.”
LUKEWARM · features · Hacker News · 2026-04-02
“I initially had LiteLLM gateway and backed it out after the security issues”
NEGATIVE · reliability · Hacker News · 2026-03-30
“LiteLLM has been getting worse and trying to get me to upgrade to a paid version. I also had issues with creating tokens for other users etc.”
NEGATIVE · features · Hacker News · 2026-03-24
“I chose litellm+langfuse (that was turned down initially in favour of helicone) and I needed to make few small code changes so Claude max auth could be read, additional headers could be passed through and within a single endpoint it could send Claude telemetry as pure pass through and real llm api through it's "models" engine (so it recognised tool calls and so on).”
POSITIVE · features · Hacker News · 2026-01-17
“LiteLLM was good in the early days. I ran into more features than bugs.”
MIXED · features · Hacker News · 2025-11-20
“bugs where tools are not working, but only for Ollama provider and only when streaming is enabled? This is one of the real instances I had to debug with LiteLLM”
NEGATIVE · reliability · Hacker News · 2025-11-19
“For ease of compatibility I've started using langchain-litellm / ChatLiteLLM for the llm model”
POSITIVE · ease of use · Reddit · 2025-04-30
Have You Used This Tool?
Sign in to share your experience with this tool.
Sign in