logoalt Hacker News

rienbdj • today at 8:03 AM • 4 replies • view on HN

There will come a point where the local models are good enough (and iPhones powerful enough) for this to be possible without privacy downsides.


Replies

raz32dust • today at 8:13 AM

A lot of use cases for agents require long running sessions. And you're likely to have many agent sessions running in parallel. These aren't going to be running on your personal devices

➕ show 4 replies
reacharavindh • today at 8:46 AM

I’m sure there is probably a skunkworks like team secretly working at Apple trying to make the hardware needed to accelerate local models enough to handle personal data processing needs without decimating the battery. I’d guess another team is probably tasked at researching a E2E encrypted remote inference mechanism where the personal data that does get out of the iPhone/ipad/Mac is encrypted with something Secure Enclave on processor, and “even Apple can’t read it”..

Apple is my long term bet for personal AI computing.

No way in hell am I letting FaceBook/OpenAI/Anthropic/Deepseek/anybody have complete access to my personal digital life. That’s just dumb.

Just look at OpenAI digging through ChatGPT logs to get the idea to solve the math problems etc. I’m sure all the subscription plans and subsidies are aimed at gathering enough breadth of real people comms to get the models to improve on wider signals…

Worst case, I don’t want to be voluntarily giving up my digital footprint to get profiled a certain way and be fed what AI overlords (or the companies that wield them really) think I should get as an answer/response.

My thoughts and activity stays private as much as practical and feasible.

➕ show 2 replies
thatsabadlook • today at 10:24 AM

They are that good now. The computer is just too expensive. The computer is too expensive because of meta, openai, anthropic, grok, etc. it's funny how this works...

jayd16 • today at 8:18 AM

Ok but look at the list... Google likely already has all that. It's not really something a normie cares about self hosting.