You... Do know that people scrape websites for non-AI reasons, right?
Why should the site owners be interested in allowing them to do that?
Why should the site owners be interested in allowing them to do that?