logoalt Hacker News

unrvl22today at 7:46 AM2 repliesview on HN

which is the bigger headline that people don't realize. this is 744b and its head to head with Kimi K3 (2.8T), smashes DS v4 pro (1.5T). even Opus and Sol are rumored to be 1.5T+ this is half the size!


Replies

AureliusMAtoday at 12:47 PM

in terms of performance the formula seems to be : dense parameters = sqrt(total*active)

Havoctoday at 11:19 AM

You do need to compare active parameter too though. The total size isn’t a reliable indicator anymore