alt Hacker NewsIf this is true, it's even more impressive that some of the open weight models that are <3.5T in size, approx 33% of its size, are within a few points of it in the artificial analysis leaderboard.
Replies
mlmonkey • today at 3:37 AM
You want to take a look at the "Scaling Laws" paper, so you can extrapolate from these numbers.
➕ show 1 reply
habosa • today at 3:16 AM
GLM 5.3 is "only" 753B parameters. Much much smaller.
Not necessarily, there could be diminishing returns on mere parameters count .
There is nothing to say for example a 1 Quadrillion parameter model will be vastly more intelligent than current SOTA especially since new training data is largely synthetic today