logoalt Hacker News

mjevanstoday at 3:21 AM1 replyview on HN

Static, Near Static (not generated on demand at least; generated only on real content update), and Login seems likely.

AI not caching things is a real issue. Sites being difficult TO cache / failing the 'wget mirror test' is the other side of the issue.


Replies

grishkatoday at 3:44 AM

What about AI not respecting robots.txt? I myself have never ran into this, but I've seen complaints of many people who did.

show 1 reply