logoalt Hacker News

Tokendoctor – See what your Claude Code use overpays

24 points • by rsaryev1997 • today at 2:19 AM • 12 comments • view on HN

Comments

Incipient • today at 8:37 AM

All of these token optimiser things...i rarely see any performance analysis. If you're cutting token usage in half, what does that do to the accuracy of the outcome? If you're automatically delegating to cheaper models, what does that do to the outcome?

Personally I've found a HUGE improvement in quality using more context, to the point that it's 'better value' - fewer outcomes I disagree with or have to fix/rework.

I've mostly done this through mechanical documentation links that are enforced and can be 'followed' with some python files that the agents use. Context is higher than just reading code, but it has been a HUGE benefit (as far as I can tell).

pseudosaid • today at 8:40 AM

Just use billion context. I customize it to set a slider so I decide how big the context window can ever grow, and it uses models to fold itself in on itself and summarize itself while retaining the entire chat history. I've managed to run chats over three thousand messages long without any negative effect. And overall, I average a seventy-four percent reduction in token usage.

urig • today at 8:05 AM

Please don't let AI write your README.md. It's illegible to humans.

relyks • today at 6:02 AM

I use this and it works well: https://github.com/rtk-ai/rtk

I'm trying to figure out if I can use multiple of these tools together without conflicts

➕ show 2 replies
mkagenius • today at 6:07 AM

> https://github.com/localixai/tokendoctor/tree/main/bench

Don't we need to run it on all of the benches those models publish?

This doesn't look very comprehensive. Moreover half of the times factory claude code is better than 'advised' one.

Although I don't discourage such experiments, I feel this one is way complicated for very little or no gain provably.

➕ show 1 reply
renegat0x0 • today at 5:55 AM

I have a list of ai related tools. There is so many of them

For example limiting token usage i think can also be achieved by 'caveman' project. It achieves it differently but the goal is same i suppose

Overall Ai tools I found:

https://github.com/rumca-js/awesome-database-top/blob/main/l...

➕ show 2 replies
ralph84 • today at 6:59 AM

These tricks last at most one model dot release.

➕ show 1 reply
pinkyclouds • today at 7:16 AM

why not having a tiny fast model summarize tool output instead, maybe with a threshold or something.