OpenAI just launched the equivalent of Velvet as a full fledged feature today.

But seperate from that you typically want some application specific storage of the current "conversation" in a very different format than raw request logging.