alt Hacker NewsI think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus.
Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.
Not sure what RDMA brings to the table.
I think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus.
Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.
Not sure what RDMA brings to the table.
RDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.