alt Hacker NewsAre you aware that a lot of model tool calls are useless and a smarter model could avoid those?
Are you aware that output tokens are priced 5x higher than input tokens?
Are you aware that a lot of model tool calls are useless and a smarter model could avoid those?
Are you aware that output tokens are priced 5x higher than input tokens?
> a lot of model tool calls are useless
That’s just wrong. File reads, searches, compiler output, are the top input token consumers in my workflow. None of them can be removed. And they are the majority of my input tokens. That’s also why labs are trying to make 1M input work, and why compaction is so important to get right.
Regarding output - yes, but that wasn’t the topic in this thread. It’s just easier to argue with input tokens that price has gone up. I have a hunch the price for output will go up similarly, but can’t prove it. The jury’s out IMO: https://news.ycombinator.com/item?id=47816960