logoalt Hacker News

consumer451today at 1:56 AM3 repliesview on HN

Ignorant questions for you and anyone else using DS:

1. who hosts the inference

2. which harness are you using with it, still CC?


Replies

oulu2006today at 2:11 AM

So everyone has their preferred way of doing it.

1. I go direct to source, i.e. DS platform, I find it cheaper than paying the openrouter tax -- I also switch it up a bit

2. I built a local LLM router, that I update with new profiles that have my preferred provider of the week (lowest token costs/speed) with fallbacks, like mimo --> DS4 etc.. if there is overloading,

3. I use 3 diff harnesses, CC/Codex + Opencode -- they all talk to each other through a custom rig system that routes messages between llms using a Rust backed structured JSON system

Not saying this is the best, it's just what I like and works for me^.

I can flow quite naturally between Opus/Astra/K3/GLM/MiMo/DS/etc.. this way and often do...more so these days with subs no longer great as they used to be.

show 1 reply
pavo-etctoday at 2:08 AM

Whatever openrouter puts me on, running in pi (though I do all comms over my xmpp wrapper).

logicchainstoday at 7:02 AM

Deepseek harness is great!