alt Hacker NewsHuman intelligence does not separate training and inference. Both are happening continuously. That's one of the major things the AI community is still completely missing.
Human intelligence does not separate training and inference. Both are happening continuously. That's one of the major things the AI community is still completely missing.
My personal opinion for the last two years or so has been that current AI agents are forever going to be highly limited so long as they don’t possess a real “memory” process. Right now they just have absurdly big working memories, and a few hacky ways of making the equivalent of Post-It notes to future iterations, but no true integration of memory into a new future self. Meaning their “learning” is fundamentally kneecapped to one specific and imperfect modality.