LLMs are basically multi-dimensional magic mirrors.

Depending on where you point them, they can be incredibly useful.

They can even be useful when you point them at each other (though increasingly difficult to get good results).

I'm excited for the promise of RSI and a future where models have inherently "live" weights, but it's not clear to me that the transformer is more than a useful tool to help us get there.