logoalt Hacker News

car • yesterday at 11:20 PM • 0 replies • view on HN

This looks and works great, super impressed. This is what Siri/Apple AI should be like.

One concern I have is about sending private info to Anthropic. So it would be great to have the option to use local AI.

Local options should support the OpenAI API that seemingly is the standard for these connections, as provided by Llama.app and Unsloth Studio for example. That way one could run against a local model and keep personal information private.

That of course begs the question if a local model is smart enough for the tasks at hand.

I'm also trying out OOMU, a similar but closed source personal assistant app for MacOS. It emphasizes privacy with local models, and even has an 'Airplane' mode. The app has a built in llama.cpp server and uses Gemma-4-4B, their own router model plus a vision model.