Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason.
But, what got me about this is that:
* every other Apple device delivered the same results
* Apple's own LLM silently failed on this device
to me that behavior suggests an unexpected failure rather than a fundamental issue; it seems Bad (TM) that Apple would ship devices where their own LLM didn't work.
FYI, the saying is "champing at the bit", it comes from horses being restrained.
As a sister comment said, floating point computations are commutative, but not associative.
a * b = b * a for all "normal" floating point numbers.
> floating point accumulation doesn't commute
It is commutative (except for NaN). It isn't associative though.