A response to this, which I think is reasonable. Its a bit of a fuzzy line, but the likelihood there is "magical maniacal planning" happening here is unlikely (about as unlikely as that planning happening in hidden vector states between layers).

https://nonlineartransform.substack.com/p/relax-about-neural...

There's also an argument here for why its _better_ for monitoring (because we have the whole state space).