alt Hacker NewsI love OpenCode! I wrote a plugin that adds two tools: prune and retrieve. Prune lets the LLM select messages to remove from the conversation and replace with a summary and key terms. The retrieve tool lets it get those original messages back in case they're needed. I've been livestreaming the development and using it on side projects to make sure it's actually effective... And it turns out it really is! It feels like working with an infinite context window.
https://www.youtube.com/live/z0JYVTAqeQM?si=oLvyLlZiFLTxL7p0
Replies
advael • yesterday at 10:56 PM
Seems interesting, but at a glance I can't find a repo or a package manager download for this. Have you made it available anywhere?
➕ show 1 reply
That doesn't sound all that useful to be honest and would likely increase costs overall due to the hit to prompt caching by removing messages