logoalt Hacker News

sdoering • today at 1:20 PM • 1 reply • view on HN

Pardon me not understanding what this is about?

Basically SETI for AI workloads? At least, this is the impression the landingpage left me with.

I am a bit lost, tbh.


Replies

railka • today at 1:35 PM

Minions is an internal enterprise system already in use at Apple. It pools idle Mac GPUs into a shared compute cluster for ML inference.

There is no distributed execution of a single LLM across multiple GPUs using tensor parallelism here. Instead, it relies on task-level parallelism-breaking down a large workload into independent subtasks that run across separate machines. For example, generating embeddings for a million documents.

➕ show 1 reply