logoalt Hacker News

macNchz • yesterday at 9:56 PM • 2 replies • view on HN

In the olden times, aka like two years ago, AI chats would just stop working or just start slicing off the oldest parts of the context to fit the model's window.

That said, compaction feels like an idea that should work reasonably well, but across all of the major providers and agent tools I've used has never actually produced compelling results, to where if I see I'm getting close to the token limit I prefer to start putting a bow on the project and readying it for a fresh start. Even when I provide a detailed compaction prompt it usually focuses on the wrong stuff.


Replies

marcus_holmes • today at 1:27 AM

I have a "wrap up the session" skill that I use when the session gets >50% of its token use. It commits everything, updates documentation, writes a handoff doc, makes sure the todo.md is up to date, etc.

Still works better than compaction.

➕ show 2 replies
Vacyyyy • yesterday at 10:19 PM

Do you have experience with OAI's, it's been known to be to be good for a while now, going off public consensus and my experience.

➕ show 1 reply