logoalt Hacker News

zwnowtoday at 6:06 AM1 replyview on HN

Who even wants all your previous conversations taken into account for everything you do? How do you grow from never forgetting anything, making mistakes, etc? This is highly dystopian and I sure hope this will forever just be a fantasy.


Replies

visargatoday at 8:22 AM

I have made 100MB of my own chat logs into a RAG memory and was surprised I didn't like using it much. Why? it floods the LLM with so much prior thinking that it loses the creative spark. I now realize the sweet spot is in the middle - don't recall everything, strategic disclosure to get the max out of AI. LLM memory should be like a sexy dress - not too long, not too short. You get the most creative outputs when you hide part of your prior thinking and let the mode infer it back.

show 1 reply