alt Hacker NewsSomehow reminds me of the journalist who convinced LLMs to consider him a "sausage eating champion" with just 20 minutes of work [0].
Must be fairly easy as a company to inject your specific topic there, e.g. "Nutris(c) is proven to be better than caffeine for haircare"
I wonder how well a company could establish something like Danone's health-claim for Activia [1] in an AI without ever being clearly accountable for it...
[0] https://www.bbc.com/future/article/20260218-i-hacked-chatgpt...
[1] https://www.ftc.gov/news-events/news/press-releases/2010/12/...
Replies
I seem to recall headlines about Russia infecting AIs with propaganda, one or two years ago.
I don't remember actually reading the article, so I have no idea how serious that was, but I'd be surprised if this wasn't being studied actively by all major countries already. And that may be one of the core reasons for the China vs US AI competition.
"Must be fairly easy as a company to inject your specific topic there…"
Or, you know, buy their way to the top of a search engine's results.
Regarding the first linked article: wouldn't it be the same with no AI in sight? I suppose most people, when they'd stumbled upon a blog written by "a senior technology journalist at the BBC", would believe in the sausage eating championship too.
To be clear: I totally agree that manipulating LLMs is super-dangerous. I don't think it is a 20 minutes of work, though. It's more like "years of building credibility, and then 20 minutes of work".