logoalt Hacker News

Terr_today at 1:59 AM5 repliesview on HN

For a dash of dystopia: Imagine a company starts using that same LLM fuzzy-matching [0] against what you intend to be normal search activity, to detect "bad" queries and "bad" users who will be blocked. Maybe they'll delete your SSO/email/videos/photos too, who knows.

I can easily imagine it happening, especially after some point where they start using the same systems to "enhance" your query.

[0] To be specific, your searches will be placed into a narrative document template, where a character Mr. Safety Bot is about to speak a verdict, and then the LLM story-generator decides whether it "fits" for Mr. Safety Bot to declare you banned.


Replies

jval43today at 6:02 AM

This is one of the reasons I currently use Gemini for daily use and research.

Google has lots of experience with search history, and presumably handles this better than new companies.

show 1 reply
userbinatortoday at 3:35 AM

Orwell's idea of "wrongthink" is more relevant than ever.

show 2 replies
genxytoday at 2:50 AM

There is prior art with Tuttle vs Buttle.

show 1 reply
Tenoketoday at 5:13 AM

If you are imagining that, you could imagine it with search doing the same 10 years ago, which would have more thoroughly prevented you from researching things.

sillysaurusxtoday at 2:50 AM

That is in fact what happened to me, except I think the final decision was made by a human since the ban came later. I didn’t issue any queries in between, so I know it was my convo about barbiturates.

show 1 reply