Also, the mathematical content here is pretty thin. Their main theorem has nothing to do with LLMs directly. It's a theorem about a five-state Markov chain, and the proof follows from standard Markov chain theory.
For those reasons, the grandiose name "LLM-Verifier Convergence Theorem" does not sit well with me.