alt Hacker NewsCost per task, time per task, quality (good luck measuring objectively between models) are the metric that matter. I don't care how much a token costs, I'm not buying tokens, I'm buying solutions.
Replies
mapontosevenths • yesterday at 9:28 PM
Are OpenAI's models delivering 50% (or more) completed tasks than they were last month? Are they delivering 50% more than Anthropic per token?
Nope to both. Not even close.
The only way it works is if you define "task" in a way that OpenAI is good at it and Anthropic isn't.
the point is that "task" is a dubiously defined unit that the frontier labs adjust to whatever makes them look good.