logoalt Hacker News

Havocyesterday at 10:46 PM1 replyview on HN

That makes no sense.

There is no reason for AI scrappers to use tens of thousands of IPs to scrape one site over and over.

That just sounds like a classic DDOS.


Replies

TurdF3rgusonyesterday at 11:11 PM

Sure there is, scrapers do that to defeat throttling. 10,000 is less than 3 hours of scraping at 1 request per second.

show 1 reply