logoalt Hacker News

dalant979today at 2:39 PM1 replyview on HN

180B?


Replies

kzrdudetoday at 2:53 PM

125B regular params, 51B engrams, 4B MTP. Something like that. It should have a label of effectively 125B params with A6B (6B active).