alt Hacker NewsMost scrapped websites have https, so you need to perform a MITM attack. Scrapers will probably notice that.
Replies
ErroneousBosh • today at 3:36 PM
How would https affect it?
If they're making a request to my machine to go and curl a page, how do they even know whether or not it was https?
➕ show 1 reply
No, you just need to stand up your own website and feed the scraper a URL to it.