> I think it is a pity they’ll likely never open source any of this stuf

The more they use cloud-hosted LLMs, the more likely it will get leaked into training data.