alt Hacker NewsI wish all the best to LiteLLM team with handling it again. I can imagine how challenging are situations like this one.
However, if anyone is looking for 20x faster and less "targeted" LiteLLM alternative - I'm work on one in Go. That's why GoModel it's called. https://github.com/ENTERPILOT/GoModel/
Replies
TZubiri • today at 3:59 PM
If you don't use any LLM router, it's infinity times faster, and infitesimally as targetted.
➕ show 2 replies
Sounds like a reasonable choice of a language.
I myself have written a small llm proxy in Go, doing nothing but injecting the real API key to outgoing requests while itself validating virtual keys it generates, and it works great.