Looking at the way they defined their test criteria, these seem like things that could be predicted with better than 50 percent accuracy by a trivial strategy. Am I mistaken? If I predict that on most edits, the program will not be fully correct but the number of passing tests will have gone up without regressing, then I ought to be correct a good deal of the time as long as the coding agent is half decent. I would expect that strategy to be less effective at predicting well-formedness, but that is also by far the worst-performing criterion they evaluated.