logoalt Hacker News

breakingcupslast Thursday at 8:56 PM0 repliesview on HN

Such as OpenAI, who will ignore robots.txt and change their user agent to evade blocks, apparently[1]

1: https://www.reddit.com/r/selfhosted/comments/1i154h7/openai_...