logoalt Hacker News

minimaxir • yesterday at 6:28 PM • 1 reply • view on HN

In an agentic pipeline, the output text is 2-5% of the total tokens used, so verbosity is a nonissue costwise. Although, higher verbosity could cause input to balloon faster and potentially cost more, but that would be captured by the cost-per-task metric.

But as noted by other replies, it's still lower than Opus/Sonnet.


Replies

jukea • yesterday at 7:35 PM

You pay for chain of thought tokens as well. Ex: Imagine asking for a single number that takes 1h to compute

➕ show 1 reply