logoalt Hacker News

999900000999 • today at 8:00 PM • 0 replies • view on HN

Once I was at a company which both had agreements to rehost certain content, and scrape the significant amount.

A couple of funny things happened, once we were clearly being blocked and my manager wanted me to figure out a way to evade said blocking.

And in another case we ended up getting scraped ourselves. Which was absolutely hilarious. I think we were able to resolve this by just contacting the website host.

I am not a lawyer, but a lot of things in America are almost 100% dependent on how much money you want to spend suing or defending yourself in court.

There are a lot of VC funded companies who more or less just scrape and resell data. If LinkedIn and few other places figure out how to actually block them , they'd be out if a business.