So in theory you could feed it incomplete text, and then ask it for the probabilities of what the next character could be?
you could, but it the model is not optimized for text
this is complex, but generating text is highly complicated and requires mode dropping to make long cohesive text
If you provide it an AST of the english language, yes.
I think the joke here is getting missed