logoalt Hacker News

f0cus10today at 1:30 PM2 repliesview on HN

chaining an option?


Replies

DennisPtoday at 3:19 PM

They say you can cluster up to four with a shared memory pool, and get three times the inference performance of a single machine.

tristortoday at 1:41 PM

RDMA is buggy and Thunderbolt only delivers 1/10th the throughput of native connectivity. 1TB of Unified Memory w/ 1.2TB/s of bandwidth with marginally ~$30k cost is a different story than 1TB of sorta Unified Memory w/ an effective 120GB/s of bandwidth with a marginally ~$40k cost + all the RDMA bugs.

show 1 reply