logoalt Hacker News

dgellowtoday at 8:06 PM0 repliesview on HN

It’s messier for LLMs because you cannot easily compare the cost between runs, outside of benchmarks. Evaluating the value of the output is already extremely hard. But then you add the fact that you don’t know the cost of the output before it is generated. And Anthropic doesn’t share their tokenizers. It’s not as simple as your examples to get a signal that tells you to spend more or less