logoalt Hacker News

epolanskitoday at 1:25 PM1 replyview on HN

Also privacy and offline capabilities.


Replies

DanielHBtoday at 1:43 PM

One thing I realized is just how much offline local models can hurt mass data collection.

For example, I needed to write an invitation letter for immigration control for a relative visiting me. Previously I would have used a search engine for a template. Today I fire up my local qwen 3.5-9b for this kind of stuff and feed it all the private data I need.

Unfortunately it is unlikely the average user will known how to avoid this data collection. Even if the LLM is local you are likely feeding the prompts to remote servers if you harness/chat-interface is not properly vetted.

show 1 reply