They’re very slow.
They're okay, generally, but slow for the price. You're more paying for the ConnectX-7 networking than inference performance.
alt Hacker News
They're okay, generally, but slow for the price. You're more paying for the ConnectX-7 networking than inference performance.