If LLMs were brains, it would be someone with severe amnesia who you had to tell them what an arm and a leg were every time. Its stored vectors of words or partial words and computations of math that run to predict the next words/partials to use to form text output. It will nearly always find the real sets of words that are load bearing to put into its output (seriously how many times do real and load bearing appear in the models, can we remove some of that).

What's interesting is most of the progression we've seen this last year in AI agent clients are very basic computer science concepts: loops, threads, arrays (of JSON) and memory management (aka context) with varying combinations of those put together and people in computing are writing about it like its some huge break through. I would love to hear a game developers perspective on comparing AI clients (not the server side LLMs/vectors/maths) with games - they seem to have very similar computing problems.