logoalt Hacker News

drawnwrentoday at 6:29 AM0 repliesview on HN

It's notable that they're so valuable because they feature 800Gbps of memory bandwidth. About twice what's available on the top end of M5, and exactly what makes llm inference fast.