Litelm: LiteLLM Without the Bloat

I strongly recommend the authors rewrite the readme by hand. It’s kind of a snif test for how much care someone out into this project.

This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept.

The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

This is a 30 minute project with a frontier LLM. I don’t see why anyone would use anyone else’s router. Techniques are valuable today. Libraries are not.

First off, cool project! It's always great to see derivatives that question the efficiency of the established product.

I think the main thing the readme is missing is the core benefits. Reducing LOC and dependencies is cool, but it would be great to understand if this provides some additional benefits like lower latency or memory requirements.

One of the 2 dependencies, httpx, isn't really maintained anymore. Pydantic picked it up as httpx2: https://pydantic.dev/docs/httpx2

How does it compare to Bifrost?