It's actually a really great idea, but it doesn't have to go beyound existing Responses or Chat Completions APIs.
We built that in my current company and it works wonders to just script entire persistent workflows with a simple SDK.