alt Hacker NewsI still think NVIDIA is a bad bet--where is their moat in the long term? Doesn't the sort of work NVIDIA engineers do look vulnerable to AI-assisted automation? NVIDIA engineers code against a well-defined test suite/specification, right?
Replies
The most reasonable story you can tell for a nVidia moat is their know-how in designing datacenter-scale hardware and getting it fabbed and deployed. That's inherently hard to replicate. CUDA itself can be replicated in theory (it's basically just a compute API) but that turns out not to be worth it since the nVidia ecosystem really is higher quality for the cost.
AMD should have been ideally placed to compete with them, and haven't.
> NVIDIA engineers code against a well-defined test suite/specification, right?
The spec is the value. And the patents.
I dont think that holds since the core cuda toolkit is proprietary
Their moat is cuda and cuda libraries and everything built on top.
When a new architecture drops, it's always PyTorch running on CUDA, other PyTorch backends are best effort, even if they reach feature parity, many industry power users went closer to the metal to squeeze performance and that stuff is too specific to Nvidia stuff.
if there is something that will beat Nvidia, it won't be something reaching feature parity with slightly better economics (like AMD, also Nvidia could just reduce their margins), it needs to be a novel approach worth rewriting the codebase for (maybe Cerebras, maybe a new player).