logoalt Hacker News

tonyhart7today at 1:17 AM1 replyview on HN

I mean this AI data scrapper would need to scan and fetch billions of website

why would they even care over 1 single website ??? You expect instiution to care out of billions website they must scrape daily


Replies

whattoday at 1:39 AM

This is probably the reason. It’s more effort to special case every site that offers dumps than to just unleash your generic scraper on it.