alt Hacker NewsDoes anyone know a good alternate project that works similarly (share multipple LLMs across a set of users)? LiteLLM has been getting worse and trying to get me to upgrade to a paid version. I also had issues with creating tokens for other users etc.
Replies
sschueller • today at 2:05 PM
I just found https://github.com/jasmedia/InferXgate which looks interesting although quite new and not supporting so many providers.
redrove • today at 2:07 PM
Bifrost is the only real alternative I'm aware of https://github.com/maximhq/bifrost
➕ show 2 replies
river_otter • today at 1:45 PM
github.com/mozilla-ai/any-llm :)
tacoooooooo • today at 1:43 PM
pydantic-ai
thibault000 • today at 3:45 PM
[dead]
If you're talking about their proxy offering, I had this exact same issue and switched to Portkey. I just use their free plan and don't care about the logs (I log separately on my own). It's way faster (probably cause their code isn't garbage like the LiteLLM code - they had a 5K+ line Python file with all their important code in it the last time I checked).