logoalt Hacker News

II2IItoday at 7:03 PM2 repliesview on HN

> But now I'm really reluctant to give more stuff to the free web. Because the fact that it gets scraped and added to a pile of training data to later be monetized really rubs me the wrong way.

The thing is, people were scraping and monetizing other people's websites long before the current LLM fad. The difference is the magnitude of the problem.

> And I can see why maintainers of sites like this, or other free but incredibly useful resources might start to get irate at that.

Those who object to the scraping fall into several camps, but the biggest complaint I am hearing is that it increases both maintenance costs and time. In other words: it sucks when people are using your work in a manner that you find offensive, but it goes beyond that by doing actual harm.


Replies

joshmarinaccitoday at 7:06 PM

A change in quantity can become a change in quality.

antisthenestoday at 7:44 PM

> The thing is, people were scraping and monetizing other people's websites long before the current LLM fad. The difference is the magnitude of the problem.

People doing it with a couple of machines and residential proxies versus Anthropic doing it with 2 data centers worth of machines.

Scale matters.