You are right, the product is almost the same as you described, intended for customers running LLM-generated code in their workflow.
This was something close to our hearts, so we thought of building it for our local use and releasing it for like-minded individuals.