I think they mean having some useful predicates P, Q such that for any input i and for any output o that the LLM can generate from that input, P(i) => Q(o).
If you could do that, why would you need an LLM? You'd already know the answer...
If you could do that, why would you need an LLM? You'd already know the answer...