In this new era it is almost zero effort to stand up a convincing website on any topic, which is mostly correct, but riddled with small confabulations and errors. It can take typing one sentence (even with grammatical errors) to do so, the bar is now zero for creating plausible 'content' and flooding the internet with it. As the article notes bad actors, but also people who have good intentions, are flooding the zone with slop.

If it was all clearly completely incorrect, it wouldn't be such a huge problem, but it is plausible and hard for humans to detect in a short time unless it is long form text.

Even search providers are giving us this new kind of generated result at the top of their results, which most people will be using blindly to verify answers. So it's turtles all the way down.

If you're not a domain expert you have no idea which things are right and which are wrong so it's very hard to determine the truth or trust results.

To top all that, LLMs are being trained on this new untrustworthy data without differentiating it from older data, and trained by other LLM instances in a sort of recursive loop to improve performance on very narrow goals. What could possibly go wrong!