I've had a thought in my mind recently. There's been a sudden push in Western countries towards "think-of-the-children" online age gating, and hence online verification tools, and any age verification tool that works can verify other things, like whether the user is a real person or not. The "that works" is doing a lot of heavy lifting there, but we should assume that the politicians pushing for this at least believe it's possible.

Of course, any push for new legislation like this has many factions, and I'm sure there's a large faction who genuinely want better CSAM scanning tools, and another large faction who want to spy on and control what people can say online.

But those factions have always existed. Why is this push coming so strongly now in so many countries, and getting so much traction, when it previously failed?

Perhaps it's because politicians have recognized this existential threat. If they can't control what fake AI accounts say online to their real citizens, and the cost of running those fake accounts is trending down to the point where they'll vastly outnumber real people, then western civilization is lost. Democracy only works when there's a reasonable amount of signal in the noise. When it's basically all noise, and the noise is specifically created to destroy the system, the system is dead.

So perhaps there's another faction for whom this think-of-the-children stuff is a way to get verification normalized, and that's a way to get real humans verified online. This would not be accepted if it was done directly (or at least, politicians believe that people wouldn't accept it, and I tend to agree).

I personally react strongly again almost any kind of online control. But for the first time in my life, where we're no longer faced with troll centers that required real humans to work, but we're instead facing millions or billions of AI agents that are rapidly becoming indistinguishable from real humans, and are specifically designed to fight a hidden war against western civilization, I don't really see any other good option either.

Small forums with strong moderation like HN are great, but they don't scale. At best they'll be small enclaves of resistance, but most people will be using larger services that are overrun by fake accounts. And realistically, if we fast forward ten years where I can spin up a few thousand (or million) fake accounts for $1000, that are indistinguishable from real humans and tell them to target any small forum of my choice, I don't think any moderation team can survive that.