> is responsible for a good portion of software crashes
I doubt it's the case, it should result in slightly different logits and generated tokens, but it shouldn't lead to crashes.
I suspect what you're facing are simply driver bugs…
It's memory/tiling alignment issues + wrong instruction/feaatures.
It's memory/tiling alignment issues + wrong instruction/feaatures.