Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
This time they just made FP8 "default", accompanied by "-BF16" model/page (previously "-FP8" was released alongside).
alt Hacker News
This time they just made FP8 "default", accompanied by "-BF16" model/page (previously "-FP8" was released alongside).