alt Hacker NewsThey will possibly all converge when they expose a "tool interface" to some kind of model-on-prem(ish) device that you install in your home. Think of an OpenAI or Anthropic or Apple or Samsung-branded "cortex" or "brain" that controls everything to some degree using fast local models, but outsource more complex orchestration up to the cloud. Smart home products will integrate with these devices because its going to open up a whole new generation of the same devices they sell, just with AI model integration this time.
These devices already have a precedent, your apple tv or google/amazon speaker thing. I think we will see these probably become LLM/model/AI gateways in the future.
Replies
Working on it, they all already expose a tool interface, you just have to know where to look for it and how to use it!
We are basically already there, with HomeKit plus open bridge that can make any device visible on HomeKit (like nest cameras) and usable in automations (it works the other way also, it’s just a good way to get compatibility).
I would like to explore some open source solutions though, it would mean setting up a local system on a Mac mini for speech recognition and local processing. Bonus is you could use Anthony Daniels (KITT) as your assistant voice.