logoalt Hacker News

sroussey10/11/20241 replyview on HN

How well does bf16 work in comparison?


Replies

KeplerBoy10/11/2024

Even worse, I'd say since it has fewer bits for the fraction. At least in the example i was mentioning, where you run into precision limits, not into range limits.

I believe bf16 was primarily designed as a storage format, since it just needs 16 zero bits added to be a valid fp32.