If only it would be possible to "close your doors to AI agents". It's not I'm afraid. Where do you draw the line? What browser is allowed?
For example, I now have to `pacman -S chromium` to buy tickets from Deutche Bahn. They accuse me of being a bot when I use firefox on linux. It's a known problem, and I think stuff like this will only get worse the longer this cat and mouse goes on.