It seems like there are a bunch of tools more or less converging on this sort of workflow - see:

https://github.com/stravu/crystal

https://github.com/imbue-ai/sculptor

https://github.com/omnara-ai/omnara