Very cool that these companies can scrape basically all extant human knowledge, utterly disregard IP/copyright/etc, and they cry foul when the tables turn.
Yep, that is exactly what happens. It's a disgrace that their models aren't open, after training on everything humanity has preserved.
They should at least release the weights of their old/deprecated models, but no, that would be losing money.
All extant human knowledge SO FAR. Remember, by the nature of the beast, the companies will always be operating in hindsight with outdated human knowledge.