> If it's publicly funded, why shouldn't AI crawlers have access to that data?
Becase it costs money to serve them the content.
If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI?
Is the answer regulate AI? Yes.
Crawlers accessing public data could be required to provide searchable access to the public data they collect. Value-for-value.