alt Hacker News> Local-first AI home security
Why would you run this on your M5 instead of a dedicated machine for it? A Jetson Orin would be faster at prefill and decode, as well as cheaper for home installation.
> Local-first AI home security
Why would you run this on your M5 instead of a dedicated machine for it? A Jetson Orin would be faster at prefill and decode, as well as cheaper for home installation.
Memory is the limitation, M5 has larger memory options. So large language model could be used.