alt Hacker NewsI recently wanted to find out which company crawls the deepest. The openAI bot was the most thorough one, it followed 405 links [1].
Replies
fleebee • yesterday at 6:39 PM
Nice stats!
I've only had GPTBot reach depth 92 on my honeypot. I guess it's not as interesting.
Wondering if after this comment, you'll get more visit from those bots.