alt Hacker NewsAI scrapers are, from the perspective of the website operator, indistinguishable from DDOS. I don't owe anyone any kind of special exception in my firewall.
AI scrapers are, from the perspective of the website operator, indistinguishable from DDOS. I don't owe anyone any kind of special exception in my firewall.
You'd have to have the slowest site on Earth to not be able to serve legitimate crawlers. Have you ever truly been DDOS'd? I have. I actually had to start self-hosting my website because back when I used Cloudflare, the people who'd DDOS my site would just take down Cloudflare's servers. They're not even a very good protection racket. They're just in it for the money and power.