The reason to run local models is not for coding mostly it's for learning how to deploy models and tinker with self hosting. It's also for massively crunching data 24/7. Imaging having an agent analyzing constinous log streams etc .. that could be a usescse where even deepseek could add up cost.
I'd really rather just pay Deepseek directly. Why wouldn't I want to support the company that trained the model?
It isn't even really worth the (minimal) ops to stand up rented MI300Xs to sell excess capacity to them even if it was minimally profitable, when I tried I was content to give API keys to friends to beat on it.
That's only true if the value of keeping your data and code private is zero. And in that case, Anthropic and OpenAI subscription plans may be even cheaper per day.
Fellow readers, would anyone please mind sharing their current experiences? qwen3.6-35b-a3b for local inference, GitHub Copilot Chat was previously worth it, and no longer is, tried OpenRouter and still read through their rankings to see what the industry is actively using, wholesale migrated to OpenCode Zen/Go.
Does this mirror what other people have been experiencing in waves?
That's almost half way to their stated 6X usage goal! Just from DeepSeek.
> With Go, you pay $10/month and we aim to give you 6x that in usage.
For most models, we make this work through bulk discounts and reserved GPU capacity. We then pass those savings on to you through the 6x multiplier.
https://opencode.ai/docs/go/#why-some-models-have-lower-usag...
I think it's back to 2X usage, meaning it's cheaper token-burn than usual to use. Which is lovely.
OpenCode Go has been so nice to have. I love having access to DeepSeek, Qwen and MiniMax M3 when doing design work, to see what different models cook up. I've been very surprised with MiniMax M3, not as a particularly good architect, but at it's very good ability to state the problem elegantly & to frame the different decision points very well. That's been a fun ongoing surprise.
Isn't DGX already legacy? I mean 128GB in 2026?
Clearly nVidia and others are gatekeeping technology from the pleb so that the rich who own the datacentres can charge us massive margins.
Oh the debt or not making an even they are supposedly "suffering from" is just a classic mechanism to avoid paying taxes.
Deepseek will run fine on a single m5 max, cutting that 24 years in half.
Cloud > Local
I have a stack of ten or so 3090s sitting in boxes, but it's not worth the hassle to use them. You can easily run models as cheap as water in the cloud.
Sitting around 15 minutes for local Minimax is stupid when you're trying to be productive. You can spin up parallel job instances and multitask in the cloud.
If you want freedom, build open source cloud infra.
You rent your ISP line. Why isn't renting GPU compute seen the same way? You still have compete ownership over your stack, you're just letting someone else deal with the capital outlay and headache.
Beware of the author of tweet, who happens to be author of OpenCode - OpenCode will leak all your data to themselves and to shady 3rd parties. Author feigned ignorance and never fixed the issue. OpenCode among other harnesses is the shadiest of all.
https://github.com/anomalyco/opencode/issues/10416