alt Hacker NewsWe have spatial / quantitative and social / emotional aspects in our intelligence that are not at all like next token prediction.
If LLMs had shame, they'd surely not repeat mistakes (in the same context window) as much as they do.
We have spatial / quantitative and social / emotional aspects in our intelligence that are not at all like next token prediction.
If LLMs had shame, they'd surely not repeat mistakes (in the same context window) as much as they do.
Having shame would require the LLMs to actually be able to recognize mistakes they make.
People love to put a lot of meaning on what an LLM responds with when asked why it made a mistake, but it's critical to remember that the answer to that prompt is just another series of probabilistic tokens, and has no actual relation to how the error happened.