logoalt Hacker News

jmyeet • today at 5:33 PM • 0 replies • view on HN

Here's one difference: currently lawyers using cloud LLMs violates attorney-client privilege. And you have to be really careful sending confidential medical information to one so as to not violate HIPAA.

More broadly, those prompts and the responses have value. There's a whole shadow economy in China of aggregating queries across Claude (etc) and then using that as training data. It's like your entire search history is for sale.

Clould infra has typically been opaque to the provider. You run an MySQL instance on an Amazon VM and Amazon doesn't have easy access to the unencrypted traffic and what you store. Cloud LLMs don't operate that way.

AI hardware is improving at a rapid pace. By 2030 I believe a significant amount of LLM usage will be local for these and other reasons.