alt Hacker NewsEven if you had a 64GB machine: Are you willing to reserve 90% of your memory to run a LLM? With dirt cheap models like deepseek-v4-flash that will run "forever" on $10, the answer for me is clearly: no.
Replies
zoobab • today at 11:13 AM
"With dirt cheap models like deepseek-v4-flash that will run "forever" on $10, the answer for me is clearly: no."
When it's free, you are the product.
➕ show 3 replies
halJordan • today at 11:24 AM
It's the size of a big vm. There's nothing wrong with reserving that much working space for one item.
I'm waiting for the speed/quality per dollar metric to go down a little bit further and then I will def run it at home.
Its not just that you send a sentence to an API endpoint, you always send EVERYTHING to that agent as a context.
You want to analyse your spending history? You now send everything to someone.
Either no one cares but understands this implication on how easy it is to really capture you or no one really things about it.
But i'm a lot more diligent on what I send. I disabled the gemini activity feature for example because google started telling me that my stuff could be reviwed by humans.