And finally, we will have the future SOAP and XML schemas promised us all those years ago!

Websites cost money. Websites won't cater to bots the same way they don't cater to the scrapers of old. Some bot companies may be charged extra to integrate their bots in some websites, though!