alt Hacker NewsThe star of the show is H3 Max Director [1], which lets you get a pseudo realtime WebRTC video feed which you can control with JSON messages.
The model is quite impressive, though obviously it depends a lot on what you're doing. But you can literally just type whatever you want and it will reasonably happen a few seconds later. Logical continuity is not included; attempting to maintain continuity is probably the bulk of the work for this experiment.
If you want to try your own version, you can vibe code an interface on top of the fal API in a few minutes, it is coding agent friendly.
Keep in mind it's super expensive; per list pricing (at least on fal), it costs $5/min to run, and the minimum is 1 minute.