How LLMs work

I learned TCP/IP by watching and reading raw packets over packet radio at 1200 baud.

I've noticed the same thing is possible if you watch the output of a slow LLM. Eventually you start to see the machinery. input tokens = output tokens, it's math. I can't exactly predict the tokens generated but I can see how they are formed. It's a lot like chess. You can't see every possible move but the mechanism is understandable.

find it difficult to engage with AI generated text. What am I getting here that I couldn't get from a chatbot.

I couldn't load the article directly due to an SSL issue, so here's the archive link:

https://archive.ph/aWtFG

Next do "why LLMs work"