logoalt Hacker News

try-working • today at 2:25 PM • 1 reply • view on HN

I built a router that lets you route between local and cloud models. Link in my profile.

Replies

embedding-shape • today at 4:57 PM

Yeah, I also built my own "router" for this:

    if (process.env.LOCAL_MODEL {
      http('localhost:3000/v1/completions')...
    } else {
      http('api.openrouter.ai/v1/completions')...
    }
➕ show 1 reply