logoalt Hacker News

aeyesyesterday at 6:25 PM4 repliesview on HN

https://arcprize.org/leaderboard

$13.62 per task - so we need another 5-10 years for the price to run this to become reasonable?

But the real question is if they just fit the model to the benchmark.


Replies

onlyrealcuzzoyesterday at 7:24 PM

Why 5-10 years?

At current rates, price per equivalent output is dropping at 99.9% over 5 years.

That's basically $0.01 in 5 years.

Does it really need to be that cheap to be worth it?

Keep in mind, $0.01 in 5 years is worth less than $0.01 today.

show 1 reply
golem14yesterday at 9:51 PM

A grad student hour is probably more expensive…

show 1 reply
re-thcyesterday at 7:51 PM

What’s reasonable? It’s less than minimum hourly wage in some countries.

show 1 reply
igraviousyesterday at 6:40 PM

That's not a long time in the grand scheme of things.

show 1 reply