IDK, prefill speed is a bigger concern for most wokflows, like agent coding, and I heard that this is quite low on macs?
That was mainly before the M4 generation when they didn't have matmul instructions.
alt Hacker News
That was mainly before the M4 generation when they didn't have matmul instructions.