logoalt Hacker News

TurdF3rgusonyesterday at 11:11 PM1 replyview on HN

Sure there is, scrapers do that to defeat throttling. 10,000 is less than 3 hours of scraping at 1 request per second.


Replies

Havoctoday at 12:55 AM

It's not 10k requests, it's 10k IPs

Having lots of IPs is helpful for scraping, but you don't need 10k. That's a botnet

show 1 reply