that would imply the learning of what the weights mean can be done unsupervised which is really cool.

it probably has however been trained on papers talking about ways they extracted subsets of LLMs as say, the part that knows chess, and would be able to then use similar commands to process the weights