alt Hacker NewsI think they are bfloat16, not FP16, but they are both 16bpw formats, so it doesn't make a size difference.
Replies
Tokumei-no-hito • 08/01/2025
pardon the ignorance but it's the first time I've heard of bfloat16.
i asked chat for an explanation and it said bfloat has a higher range (like fp32) but less precision.
what does that mean for image generation and why was bfloat chosen over fp?
➕ show 1 reply
Wiki article on bfloat16 for reference, since it was new to me: https://en.wikipedia.org/wiki/Bfloat16_floating-point_format