The Apple M series chips are solid for inference.
Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.
Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.