alt Hacker NewsYou could buy five Strix Halo systems at $2000 each, network them and run it.
Rough estimage: 12.5:2.2 so you should get around 5.5 tokens/s.
You could buy five Strix Halo systems at $2000 each, network them and run it.
Rough estimage: 12.5:2.2 so you should get around 5.5 tokens/s.
Is the software/drivers for networking LLMs on Strix Halo there yet? I was under the impression a few weeks ago that it's veeeery early stages and terribly slow.