logoalt Hacker News

Azantysyesterday at 8:34 PM1 replyview on HN

Its 27B not 37B and having just 27B in total and 3T and like 30B active of those is still totally different. A 120B with 5B active is still much slower than a proper 5B. Just like the new Ling 3.0 Tiny with 8B and 1B active only gets around 120tk/s compared to 250tk/s which a real 1B one gets on my hardware.


Replies

jakswayesterday at 9:39 PM

Thanks for mentioning Ling 3 Tiny. This model has completely bypassed me and seems promising for how small it is.