alt Hacker News> isnt available in the west [...] Can anyone explain the allure of the Nvidia box
The first part might answer the second one. Otherwise, the lack of CUDA and the nvidia ecosystem of tooling could also explain why it doesn't seem so interesting for AI tasks.
Replies
But strix halo boxes themselves are available, just not that one. And despite my concerns about what's said about Cuda and ROCm I have never had a problem running any model, for image or text or voice, the community has done great work in making things work. So the point of the question stands.
It's also interesting that the most high end Chinese equipment, both prosumer things like these boxes but also the Huawei professional stack is just not available in the places it would be most appreciated. Not sure if thats china tit for tat, or western "we don't want your commie hardware anyways"
But for a lot of people it sucks cause nobody should be paying 4.2k for this product. The value isn't there.
Yep, stuff is more likely to "just work" on NVidia. Example: pytorch
In most benchmarks, the Spark is also faster at the prompt processing / prefill phase.