With MTP? I get 25-30 TPS on a strix halo. 50+ on a M5 max should very doable. Dflash (2) will push your TG even further
It's a bit deceptive to state inference speeds without mentioning the additional things you're doing to achieve them
alt Hacker News
It's a bit deceptive to state inference speeds without mentioning the additional things you're doing to achieve them