Apple has made some good progress on memory sharing over thunderbolt. If they could get that ironed out you maybe could run a good LLM on a cluster of Mac minis. Again you cannot today but people are working on it. One guy might have gotten it to work but it’s not ready for prime time yet.
> Apple has made some good progress on memory sharing over thunderbolt
The only reason that Thunderbolt exists is to expose DMA over an artificial PCI channel. I'd hope they've made progress on it, Thunderbolt has only been around for fourteen years after all.