alt Hacker NewsWe cantnrun local models on them? They must have some sort of api exposed right? Qualcomm has the Snapdragon Neural Processing Engine iirc
Replies
InfraScaler • today at 3:10 PM
Yes, you can. Of course relatively limited, but you absolutely can run local models.
Based on my own testing, the Windows drivers are a bit restricted to do some more advanced stuff, and it may be due to some security issues in the past? at least that is what I gathered from exploring this issue with GLM 5.3
You can do cool experiments with them. But nothing a typical consumer is likely to care about.