logoalt Hacker News

philistinetoday at 3:43 PM1 replyview on HN

> It's probably a good idea to rather strictly partition your conversations to stick to a single topic.

You assume that UI is sacrosanct and the same everywhere. Those LLM providers are already offering to mingle all your conversations together. Gemini from Google for example defaults to memory from every conversation, and it's safe to assume the option to disable it will be eventually removed.


Replies

jerftoday at 4:19 PM

Memory isn't what I meant by the partitioning; I meant the entire context of the memory.

But to your implied point about getting an advertisement into a memory file... that makes it even more amusing to hack Google's own AI to put Time's ads into it. I think that's probably an easier problem for Google to solve, too, though. The small size and the way that a memory is going be a stereotypical summary makes it easier to filter out the ads Google doesn't want...

... but it'll cost them. That's an AI-complete problem and they're going to have to run LLMs over the memories to filter them, at their expense.

The most obvious fix to me is to have an LLM try to pre-filter out the ads from Time's content before feeding that as pristine content to the "core" AI so it won't be corrupted by the advertisement, but the LLM doing the filtering has to be at least as smart as the one using the content and/or the one inserting the ads. (A dumber one can filter the obvious stuff, but then the obvious next step in the arms race is for Time to tell their AI to be more clever about it, and a smarter AI will dominate the dumb cheap AIs here.) This is going to be an expensive setup. And there will be semantic loss in any such filter, too.