Information is either public or it is not.

If it is public, it will be scraped, AI companies are irrelevant here.

If information is truly sensitive, do not make it public, and that's completely fine. This might have been the case here.