logoalt Hacker News

tim333today at 10:35 AM2 repliesview on HN

The trend with email, websites and so on has been to use some large cloud service rather than self host as it's easier. My bet is AI will be similar.


Replies

heavyset_gotoday at 12:40 PM

You can turn a local model on and off as needed, and it will still function as expected. If you turn off your self-hosted server, you don't get email.

With self-hosted email, you need persistent infrastructure and domain knowledge to leverage it. With a local model, you just click a button and tell it what to do.

With email, there is a necessary burden to outsource. Your local model is just there like Chrome/Edge/Safari is just there, there is no burden.

ameliustoday at 10:53 AM

But AI is not about connectivity. Local models are just about as useful without an internet connection. Also, the hardware can fit in a small enclosure.