logoalt Hacker News

adchurchyesterday at 9:44 PM0 repliesview on HN

We haven't experimented with routing to local LLMs much. Technically they benefit from the cache too although it's more a question of latency than cost. But tbh I haven't seen great results in the wild from working with local LLMs for coding - curious if you've had any success with them?