What exactly are they self hosting here? Probably not the model, right? So just the harness?
That does sound like the worst of both worlds: You get the dependency and data protection issues of a cloud solution, but you also have to maintain a home server to keep the agent running on?
> but you also have to maintain a home server to keep the agent running on
I'm not fascinated by the idea that a lot of people here don't have multiple Mac minis or minisforum or beelink systems running at home. That's been a constant I've seen in tech since the 90s.
"maintain a home server" in this case roughly means "park a headless Mac mini (or laptop or RPi) on your desk"
And you can use a local LLM if you want to eliminate the cloud dependency.