logoalt Hacker News

bob778today at 1:04 AM1 replyview on HN

> Preliminary trials with Claude Mythos Preview showed that it would not provide an apples-to-apples comparison with other models because of how we had set up the experiment and how the model was served.

What does this mean? My guess is they couldn’t co-locate Mythos close enough to reduce latency?

(I’m assuming this experiment pre-dates the export controls)


Replies

georgemcbaytoday at 1:25 AM

> My guess is they couldn’t co-locate Mythos close enough to reduce latency?

I doubt network latency is the reason. Even when connecting from literally across the world network latency is lost in the noise of overall response latency of even fast models.

The overall response latency of the model very well could have been the difference, though. AFAIK Mythos is structured to do relatively slow "deep thinking".

show 1 reply