I have a 128GB M5 Max, and it sucks at this stage. 50-70 tok/s might be something...
50-70tk/s is what I get on my m5 max on a 5-6bit Qwen 3.8 27B?
alt Hacker News
50-70tk/s is what I get on my m5 max on a 5-6bit Qwen 3.8 27B?