Yep. But AI trawlers don't use it. Ask them why.
Do we know it's AI trawlers?
And not just generally degenerate bots? Or just one evil bot network?
Do we know it's AI trawlers?
And not just generally degenerate bots? Or just one evil bot network?