logoalt Hacker News

geek_attoday at 2:13 PM1 replyview on HN

The best solution to this for me is to self host litellm or a different router and use model aliases. For example I have a model called "coding" and when a new good model comes out I just switch the backend without needing to change the alias or the key in my projects (opencode, etc).

I have a few of them even a smart router called "agents" which will use local models but if it thinks the request might require higher reasoning it's routing to a different model


Replies

try-workingtoday at 2:25 PM

I built a router that lets you route between local and cloud models. Link in my profile.

show 1 reply