logoalt Hacker News

hollowturtlelast Thursday at 11:52 PM6 repliesview on HN

If the LLMs are the "new Google" one solution would be for them to pay you when scraping your content, so you both have an incentive, you're more willing to be scraped and they'll try to not abuse you because it will cost them at every visit. If your content is valuable and requested on prompts they will scrape you more and so on. I can't see other solutions honestly. For now they decided to go full evil and abuse everyone


Replies

jrm4yesterday at 1:21 PM

No disrespect to op, but I'm baffled as to how people keep coming up with ideas like this as if they are viable.

Google is never ever ever ever going to "pay to scrape." I'm genuinely baffled as to how people think it would possibly come to this.

show 1 reply
nkriscyesterday at 2:39 PM

The only way that would work is if they were legally required to. And even then, it probably wouldn’t work unless failure to comply was a criminal offense. You know what? Even then it still might not work.

vivzkestrelyesterday at 3:31 AM

or turn your blog into a frontend/backend combo. keep the frontend as an SPA so that the page has nothing on it. have your backend send data in encrypted format and the AI scrapers would need to do a tonne of work in order to figure out what your data is. If everyone uses a different key and different encryption algorithm suddenly all their server time is busted decrypting stuff

show 2 replies
PunchyHamsteryesterday at 9:53 AM

So they won't pay you and just scrape pages that have it public, and you will never get traffic from search again until you let them scrape

n1xis10tyesterday at 12:12 AM

This would require new laws though, wouldn’t it?

show 1 reply