Ok what about memory systems though (basically LLM modifies its own RAG context) - that should allow commits and changing dispositions over time?
Humans change over time due to what they experience. It’s different from waking up from a ten-year coma and having access to a record of what happened to yourself in an alternative timeline where you didn’t fall into the coma.
RAG context memory and modifying the weights are two different things. As far as I know, models can't modify their weights reliably.