logoalt Hacker News

zozbot234today at 7:58 PM4 repliesview on HN

Answering 2,500 independent questions is an embarrassingly parallel workload, all it needs is scale out. It would be more meaningful to know how much time was required for a single complete answer to a difficult HLE question.


Replies

desmondltoday at 8:04 PM

The animation in the article shows GPT-5.6 Sol Ultrafast solving a question at 3 secs vs Fable's 27 secs. The "11 hour vs 78 hours" animation implied that they were solved in sequence and not in parallel

jcimstoday at 8:22 PM

>Answering 2,500 independent questions is an embarrassingly parallel workload

So is calculating the total time required to answer all of the questions.

whimsicalismtoday at 8:05 PM

i assume they meant serially....

baqtoday at 8:22 PM

Amadahl’s law dictates it’s approximately always better (as in, more efficient computationally) to have one super fast thing than many slower things doing the same job in parallel.

show 2 replies