alt Hacker NewsLooking at HF, it looks like the unquantized version is half the size of glm-5.2 756 GB vs 1.51 TB. I wonder how they were able to optimize it this well
Replies
jauntywundrkind • today at 6:13 PM
FP8 vs BF16. But yeah, nice job.
Looking at HF, it looks like the unquantized version is half the size of glm-5.2 756 GB vs 1.51 TB. I wonder how they were able to optimize it this well
FP8 vs BF16. But yeah, nice job.
FP8 experts not BF16.