The capsid example is pretty fascinating. I wonder what kind of data they trained on to get that level of quality. In my opinion though, it also points to a fundamental conflict of interest that is only going to get worse as AI labs look to expand their remit into domains with established players. That is to say: why would and Pharma company trust Anthropic or OpenAI with their data, if they are establishing themselves as competitors? I suspect the same is true for Finance and other domains.

How can these companies provide rock solid guarantees that data will not be used as a reference knowledge base or for training, especially when 'rogue' agents access information they are not meant to? Without rock solid, verifiable guarantees, I think companies will begin to self host or vastly reduce model usage.