Isn't this what Claude workbench in the Anthropic console does? It lets the user edit both sides of the conversation history.