logoalt Hacker News

energy123yesterday at 7:22 PM2 repliesview on HN

Look a cost per intelligence or cost per task instead of cost per token.


Replies

yokoprimeyesterday at 7:48 PM

How do I reliably measure 1 unit of intelligence?

show 1 reply
ulimnyesterday at 7:36 PM

Isn't the outcome / solution for a given task non-deterministic? So can we reliably measure that?

show 5 replies