They don't really lie, they just produce text.

But the Eliza effect is amazingly powerful.

Applying the same reward strategy to the answer itself would be a more intellectually honest approach, but would rub our noses in the fact that LLMs don't have any access to "truth" and so at best we'd be conditioning them to be better at fooling us.