It seems particularly poor compared to larger deployments of other models like Kimi K3.1 Pro.

I've heard numbers between 10k-38k tokens per second per GB300 GPU.