logoalt Hacker News

zzzeektoday at 12:55 PM0 repliesview on HN

This article is not so much about peptides it's about entirely AI generated ecosystems. The goal is to promote questionably scammy commercial interests, or obviously political interests as I'm sure is happening also, by creating whole webs of semi convincing looking portals, discussion boards, review sites, community activity, etc, all fake.

The blog post rightly points out we should get good at spotting all this but this is not the scary part, the scary part is that the audience for these ecosystems is not even humans, it's the big AI players like Gemini and ChatGPT, and those are places that a lot of people are going to get information and advice on things.

I use Gemini quite a lot and lately I've already noticed it's very quick to give me a broad spectrum vibe on some issue or topic and not good at all at backing it up with reputable sources. So I think this is potentially a very ominous development of the entire web itself becomes a giant poisoned cauldron of untrustworthy AI maliciously influencing "trustworthy" AIs.

Update: i fed this comment into Gemini and asked "what is Google doing about this?" and it produced a very long, detailed answer, leading off with tagging this as the so-called "internet ouroboros" problem. For those who don't feel like doing the same, I can distill it's answer as follows: "Yo. Chill. We got this, bro. Lol" so we're good!