Interesting, thanks for sharing!
A scripting API makes the problem much more approachable, but what about those videos where Astra is drawing people from a photo? Here's one using canva: https://x.com/iam_zachi/status/2095992132620136677
Is that also using scripting to batch updates? It does look as if the mouse is moving.
Yeah that one looks like controlled mouse updates. I wonder if they sped up the video?