alt Hacker NewsDoes it work though? The big LLM crawlers do not read llms.txt so will they read and follow the same instructions as HTML?
Replies
prismlfx • today at 3:49 PM
Where did you see the big crawlers don't read it? Anthropic does.. they're pretty big.
patwards • today at 3:20 PM
Yeah I want to know how many donations they get
mapcars • today at 1:10 PM
I have no idea, in theory it might catch some miss-configured agents off-guard
Someone has to have done or is doing an experiment with this right? I also think that if it was an actual profitable thing then we would know about it pretty quickly. It would pop up everywhere