alt Hacker NewsCan you run an industry level LLM at home?
If not, you're changing learning to cook for Uber only meals.
And since the alternative is starving, Uber will boil the pot.
Don't give up your self sufficiency.
Replies
sd9 • today at 12:36 PM
I’m very good at the handcrafted stuff, I’ve been doing this a while. I don’t feel like giving up my self sufficiency, I just feel like the writing is on the wall.
➕ show 1 reply
loeg • today at 1:37 PM
The costs just aren't that high. They could be 10x higher and it still wouldn't be a huge deal.
Almondsetat • today at 1:17 PM
Can you build a computer at home?
There is absolutely nothing self-sufficient about computer hardware
➕ show 2 replies
> Can you run an industry level LLM at home?
Assuming that by "at home" you mean using ordinary hardware, not something that costs as much as a car. Yes, very slowly, for simple tests. (Not proprietary models obviously, but quite capable ones nonetheless.) Not exactly viable for agentic coding that needs boatloads of tokens for the simplest things. But then you can run smaller local models that are still quite capable for many things.