logoalt Hacker News

segmondy • today at 5:04 AM • 8 replies • view on HN

My local model never says no. I never get banned. If I want to do security stuff, reverse engine, there it goes! Do I wanna chat about politics? No problem! Do I want it to analyze medical stuff? I don't get to hear that it's not a doctor and I should call 911. Do I want to explore legal docs, no problem! There are lots of things that cloud models will say no to! I read that don't even agree to help with advanced biology and chemistry topic much. I also never run out of tokens, no 5 hr limit. I can run it 24/7. I don't run out of tokens. I can run 16 sub agents at the same time, non stop! 1-4 billion tokens a month? No problem. Any agent harness I want! No restrictions. Privacy all day. My own true system prompt, not something someone has determined, no filters. Furthermore, there are many open weight cloud models that don't have equivalent online. For a while before cloud models got good at math, the best model at math was DeepSeekv2 Math and there was no API. The only way to use it was to run local. All sorts of audio models, image/video models, etc. No multiple subscription needed. Private UI for my family, kids included (I can guard what kids infer). Got a friend that really needs some tokens? I give em access through private VPN. Telling someone that they are paying for decades of Claude for local AI is like telling someone they are paying for decades of public transport when they buy a car. Sure, you are right, but ...


Replies

Gareth321 • today at 7:40 AM

Also no political censorship, and it doesn’t report you to the police when it suspects you did something illegal. That really happened, by the way.

Now I want a local LLM server :( $25k is just so much money.

➕ show 5 replies
ceejayoz • today at 10:29 AM

> My local model never says no.

> I don't get to hear that it's not a doctor and I should call 911.

https://en.wikipedia.org/wiki/Darwin_Awards

➕ show 1 reply
jacquesm • today at 5:06 AM

Exactly, that's the spirit. I pool the resources with some friends as well.

latentsea • today at 7:26 AM

> My local model never says no. I never get banned.

So much this. Plus everything else you mentioned. The freedom and control is real.

jack_pp • today at 10:13 AM

isn't it the same using the same model you host locally but through a cloud provider? does the $ math favour a local setup then?

Forgeties79 • today at 8:42 AM

I think both of y’all glossed over the $25k of it all pretty quickly. This isn’t remotely an option for anyone.

➕ show 2 replies
charcircuit • today at 10:23 AM

>I don't get to hear that it's not a doctor and I should call 911.

Local models can do this and with tool use they can even call emergency services for you on your behalf.