> I guess maybe they have some internal M-series server product they just haven’t bothered to release to the public, and features like this are downstream of that?

Or do they have some real server-grade product coming down the line, and are releasing this ahead of it so that 3rd party software supports it on launch day?

The Mac Studio, in some ways, is in a class of its own for LLM inference. I think this is Apple leaning into that. They didn't add RDMA for general server clustering usefulness. They added it so you can put 4 Studios together in an LLM inferencing cluster exactly as demonstrated in the article.

last I heard for the private compute features they were racking and stacking m2 mac pros

Do they run any of their own datacenter stuff ? I thought they just outsourced to GCP

Blog posts like this one are great marketing.

> rack mount hardware

I guess they prefer that third parties deal with that. There’s rack mount shelves for Mac Minis and Studios.

These are my own questions - asked since the first mac mini was introduced:

- Why is the tooling so lame ?

- What do they, themselves, use internally ?

Stringing together mac minis (or a "Studio", whatever) with thunderbolt cables ... Christ.

thunderbolt rdma is quite clearly the nuclear option for remote management.

I don't know what you're bemused by - there's no mystery here - you can read the release notes where it literally says this was added to support MLX:

https://developer.apple.com/documentation/macos-release-note...

Which I'm sure you saw in literally yesterday's thread about the exact same thing.