alt Hacker News“888 KiB Assistant” but the assistant itself is a multi terabyte rental-only model stored in some mysterious data center.
Replies
amelius • yesterday at 5:22 PM
I'm getting "serverless" flashbacks.
Rebelgecko • yesterday at 6:28 PM
It seems to support connecting to your own LLM on the same LAN
➕ show 2 replies
kristianpaul • yesterday at 6:42 PM
My model is at home... just 16Gb still a lot but just FYI
The whole point is that this fits on an ESP32, which has wifi. We're not quite at the point where it makes sense to run the whole thing locally - if you do try it, it will need a fan, and be loud etc.
For my part, I installed Nanoclaw on my Arch derived OS (I love Arch!), and it worked fine until the next day some update decided to revert the power management settings, and now my glorious assistant is dead.
There's something to be said for a barebones OS. No bullshit, no updates.
Also, playing with hardware watchdog timers and GPIOs and DACs can be so much fun.