logoalt Hacker News

password4321today at 10:03 AM1 replyview on HN

This is interesting to me because reducing context & token usage is in the user's best interest but not in the financial interest of AI vendors. I am not an expert but it sounds like your "one simple trick" would fix context issues and allow much tighter control over token usage. Thanks for being willing to share this tip in an HN comment, changing how those in the know use AI agents going forward -- it's hard to keep up!


Replies

Jgrubbtoday at 11:39 AM

The tokens are still being burnt, they're just doing so in a parallel dimension from the users main context window.

show 2 replies