Yeah, that's because the original npus were a rush job, the amd AI Max is the only one that's worth anything in my opinion.
The Apple M series chips are solid for inference.
Is that because of the actual processing unit or because they doubled the width of the memory bus?
I have a Strix Halo 395 128GB laptop running Ubuntu from HP. I have not been able to do anything with the NPU. I was hoping it could be used for OpenCL, but does not seem so.
What examples do you have of making the NPU in this processor useful please?