"Who cares if they just predict the next token?"

Exactly. I also only write one word at a time. Who knows what is going on in order to come up with that word.