alt Hacker News> If a company makes a significantly better model, shouldn't it be able to explain how it's better to any competitor?
No. Not if it's not trained on any materials that reveal the secret sauce on why it's better.
LLM's don't possess introspection into their own training process or architecture.
That's my point. Anything that could exist that's significantly "better" would be able to share more about its creation. And anything that could be significantly better would have to be capable of "understanding" things it wasn't trained on.