logoalt Hacker News

bri3dyesterday at 11:11 PM3 repliesview on HN

Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason.

But, what got me about this is that:

* every other Apple device delivered the same results

* Apple's own LLM silently failed on this device

to me that behavior suggests an unexpected failure rather than a fundamental issue; it seems Bad (TM) that Apple would ship devices where their own LLM didn't work.


Replies

sva_today at 12:53 AM

> floating point accumulation doesn't commute

It is commutative (except for NaN). It isn't associative though.

show 1 reply
danpalmertoday at 12:17 AM

FYI, the saying is "champing at the bit", it comes from horses being restrained.

show 2 replies
BeetleBtoday at 1:54 AM

As a sister comment said, floating point computations are commutative, but not associative.

a * b = b * a for all "normal" floating point numbers.