Real search engines respect robots.txt so you could just tell them not to enter Markov Chain Hell.
I suspect AI crawler would also (quickly learn to) respect it also?
alt Hacker News
I suspect AI crawler would also (quickly learn to) respect it also?