I don’t think users (as in the general population) have a good track record of being judicious with how they share data. In the past with social media etc it was consistently the opposite, if the price is lower or free people tick any box and hand of all their personal data. Might turn out the same here too no?
Not arguing against on-device LLMs, I also wish it were so.