logoalt Hacker News

ccgregyesterday at 5:58 PM1 replyview on HN

One way that Cloudflare is gatekeeping is by declaring which bots are AI Bots. Common Crawl's CCBot is used for a lot of stuff -- it's an archive, there are more than 10,000 research papers citing common crawl, mostly not AI -- but Cloudflare deems CCBot to be an "AI Bot", and I suspect most website owners don't have any idea what the list of AI Bots is and how they were chosen.


Replies

lyu07282today at 12:40 AM

would be an obvious loophole if you could just use CC instead of paying cloudflare no?

show 1 reply