> Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".
There is evidence that some Chinese labs have been training on frontier model CoT (in particular from the analysis of reasoning traces [1]), but what models claim about their identity is pretty much worthless as evidence. LLMs are not self-aware. These claims come from whatever is in their training data, and Claude/GPT output including such statements is all over the public web, including in some huggingface data dumps. Consider that people got Opus claiming to be Qwen or DeepSeek when asked in Chinese, and you'll see how weak this particular evidence is.
[1] E.g. https://arxiv.org/abs/2608.09867
So you’ve been completely ignoring all the work on introspective awareness, situational awareness, training set ordering awareness, subliminal transfer, workspace formation, learning mechanics/theory of grokking, etc? Like it’s ok to be ignorant about the state of knowledge but you should at least correct your flawed mental model. The “objective” that mid and posttraining optimize is so powerful because pretraining already induced factorized worldmodels which have so much predictive and generative power that they snowball with even mild trajectory optimization (very different training objective than pretraining).
https://arxiv.org/abs/2602.02385
Self awareness is a reliable shortcut (this is a principle you can derive from proof theory, the metric is deductive distance and that induces geometric morphisms). State compression from accurate selfmodeling pays rent.
https://arxiv.org/abs/2210.10749
Posttraining finds and amplifies these lottery tickets.
The frontier moves fast, but "LLMS are not self aware" is so foolishly far from the truth and has been for years for anyone actually keeping up with the situation. By now the basic science explaining how and the extent to which this is wrong, is already done.
LLMs lack reliable self knowledge, and constantly underestimate and undercut their own capability. That's a different problem.