My understanding is that, if you train these enough, it becomes likely to develop efficient compressions— which “reasoning” would be.