alt Hacker NewsWhy is on-device AI the future? What is your reasoning behind this? Look at the proportion of things we compute on someone else’s computer relative to what we compute on our own device. Why would this change for LLMs?
Why is on-device AI the future? What is your reasoning behind this? Look at the proportion of things we compute on someone else’s computer relative to what we compute on our own device. Why would this change for LLMs?
I think the reasoning is similar to why Amazon notification emails are very generic: user data is used for various purposes that a growing number of users and 3rd parties have concerns about.
In addition to on-device, Apple is making efforts to secure computations that need to occur off-device, see: https://security.apple.com/documentation/private-cloud-compu...