logoalt Hacker News

knowrijulast Wednesday at 10:24 AM1 replyview on HN

When ChatGPT takes 20 minutes to reason, is it actually spending all the time burning tokens or does a bulk of the time go into 'scheduling' waits. If someone specifically selected xhigh reasoning, I am guessing it can be processed with high batch count.


Replies