alt Hacker NewsThe general consensus here is also that a DDOS attack is bad. I haven't seen objections against respectful scraping. You can say many things about AI scrapers but I wouldn't call them respectful at all.
Replies
BenjiWiebe • last Friday at 12:49 PM
Do people truly dislike an organic DDoS?
So much real human traffic that it brings their site down?
I mean yes it's a problem, but it's a good problem.
➕ show 1 reply
charcircuit • last Friday at 11:47 AM
Yet HN does it when linking to poorly optimized sites. I doubt people running forges would complain about AI scrapers if their sites were optimized for serving the static content that is being requested.
a) There are too damn many of them.
b) They have a complete lack of respect for robots.txt
I'm starting to think that aggressive scrapers are part of an ongoing business tactic against the decentralized web. Gmail makes self hosted mail servers jump through arduous and poorly documented hoops, and now self hosted services are being DDOSed by hordes of scrapers…