It's interesting that we still need to go into these "try again until you find the correct answer" loops, and often still need to tell the model to ground their claims in facts. Models have gotten better at this but I still see myself asking "are you sure?" way too often.

If they tackle that, I think models will be perceived as much smarter than they are now - even though now with the right direction they can already do so so much.