Literally just finished building a personal orchestrator system I wanted and had this very much in back of my mind.

Ended up doing a mix. Built on compose for now but in a manner that’ll lift and shift to k8s easily enough. Its containers talking over network either way