logoalt Hacker News

regularfrytoday at 12:08 PM2 repliesview on HN

Which sounds uncomfortably like human memory, which gets rewritten from one recollection to the next. Somehow, we cope.


Replies

Dansvidaniatoday at 5:16 PM

I disagree. Human memory is literally changing the weights in your neural network. Like, exactly the same.

So in the machine learning world, it would need to be continuous re-training (I think its called fine-tuning now?). Context is not "like human memory". It's more like writing yourself a post-it note that you put in a binder and hand over to a new person to continue the task at a later date.

Its just words that you write to the next person that in LLM world happens to be a copy of the same you that started, no learning happens.

It might guide you, yes, but that's a different story.

0xbadcafebeetoday at 4:49 PM

Ever seen the movie Memento? That's LLM memory.