alt Hacker NewsI can't believe this was downvoted. It makes a lot of sense that it would be highly useful to have mass custom inference chips.
I can't believe this was downvoted. It makes a lot of sense that it would be highly useful to have mass custom inference chips.
It's quite easy to understand. The tech industry has gone through 4-5 generations of obsolete NPU hardware that was dead-on-arrival. Meanwhile, there are still GPUs from 2014-2016 that run CUDA and are more power efficient than the NPUs.
The industry has to copy CUDA, or give up and focus on raster. ASIC solutions are a snipe chase, not to mention small and slow.