alt Hacker News> And yes, my site gets its data by scraping those public documents. So I'm a scraper writing a blog post complaining about scrapers. I'm aware of how that sounds.
Replies
aeturnum • today at 3:38 PM
Similar to the dose making the poison - the thing that jumped out at me in this blog was the ratio of scraping to visits. Unless OP is scraping thousands of times a day I don't really think they're in the same class as the bots they are blocking.
➕ show 1 reply
ethersteeds • today at 3:23 PM
Who scrapes the scrapemen?
alansaber • today at 3:36 PM
Live by the scraper, die by the scraper
There's a difference between someone running a scraping tool occasionally and bots constantly and rapidly re-scraping the same site over and over again