alt Hacker Newswhat i say about this, is that an llm is just a big file, there is nothing 'not private' about it.
if you are happy with off-prem then the llm is ok too, if you need on-prem this is when you will need local.
what i say about this, is that an llm is just a big file, there is nothing 'not private' about it.
if you are happy with off-prem then the llm is ok too, if you need on-prem this is when you will need local.
> an llm is just a big file, there is nothing 'not private' about it.
The private thing is the prompt.
But also, a local LLM opens up the possibility of agentic workflows that don't have to touch the Internet.