alt Hacker NewsYes, but still, what about users looking for NPU support. What happened to Microsoft's copilot+ PC campaign? (the NPU hardware, not the logo key and ad campaign) AMD's XDNA2 NPU is best supported by ONNX, I think Qualcomm Hexagon is too. The best consumer unified architectures are Apple, AMD ai+ and Qualcomm Snapdragon X Elite, even intel has an NPU offering.
Replies
NPUs you can find in AMD high-end CPUs are closer to specialized DSPs (basically big VLIW/SIMD vector units).
People love doing heavy math stuff with them (https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai... - not my blog)
There are plenty of smaller less powerful open weights models if all you have to run it on is an NPU.
This is a much larger more powerful model, so running it locally will not be for everyone, but you can still run it via a hosting service such as Fireworks AI.
NPUs are meant for tiny, tiny models that can run basically at all times but cannot affect battery life (e.g. translation, live-video cleanup, filesearch etc.), not for big LLMs. This is about 500 times to large for a NPU.