alt Hacker NewsThey will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense.
They will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense.
Until hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity.
There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care.