alt Hacker NewsCF is trying to double dip: they are charging users for their CDN, and now they try to also charge for the privilege of accessing their user's content.
While I love to see openai get scammed I don't think it will stop there. How cheap and useful do you think Kagi or other search engines can stay with this racket? How will Internet Archive operate?
Replies
> How will Internet Archive operate?
Presumably increasingly less and less effectively, at least if they continue honoring robots.txt and don't implement scraping protection bypass mechanisms.
https://www.theverge.com/news/757538/reddit-internet-archive...
"CF is trying to double dip: they are charging users for their CDN, and now they try to also charge for the privilege of accessing their user's content."
Don't forget that cloudflare provides service to the very botnets and flooders/booters they purport to protect against.
Would that be triple-dipping ? Or do we have a special term for this specific behavior ?
The Internet Archive will potentially receive an exemption if they embargo content crawled and dark it (stored but not publicly available) until an agreed upon future date.
How is this a racket? This is a service website owners want, and it (that is, Cloudflare’s resurrection of the 402 Payment Required response) seems to be one of the few schemes that can work at scale. The current situation, where AI companies benefit from content created under the premise of advertising revenue, is not just unethical, it’s uneconomical to the point of driving content creators out of business.