alt Hacker NewsWhy shouldn't you? It's your device, it has hardware made specifically for inference.
What's to be gained, other than battery life, by offloading inference to someone else? To be lost, at least, is your data ownership and perhaps money.
Why shouldn't you? It's your device, it has hardware made specifically for inference.
What's to be gained, other than battery life, by offloading inference to someone else? To be lost, at least, is your data ownership and perhaps money.
> What's to be gained... by offloading inference to someone else?
Access to models that local hardware can't run. The kind of model that an iphone struggles to run is blown out of the water by most low end hosted models. Its the same reason that most devs opt for claude code, cursor, copilot, etc. instead of using hosted models for coding assistance.