alt Hacker NewsI'd rather have a site showing how well my site is protected from being accessed by AI agents would be preferable, and advises how I can lock it down further. Basically, the exact opposite of this.
Replies
celso • today at 4:23 PM
You might want to take a look at AI Crawl Controls https://developers.cloudflare.com/ai-crawl-control/
➕ show 1 reply
gosub100 • today at 4:59 PM
Maybe we can start a new protocol where the html is encrypted, and the viewer must try 2^10 to 2^20 hashes before the decryption key is discovered. Same formula that BTC mining uses. It would be negligible cost for any single user but terribly expensive for crawling en-masse.
➕ show 2 replies
I am building a product to help with this, please write me (email in profile), I would love to hear more about what you're trying to protect.