Does an LLM scoring well on the Mensa test translate to it doing excellent and factual police reporting? It is probably not true of humans doing well on the Mensa, why would it be true of an LLM?

We should probably rigorously verify that, for a role that itself is about rigorous verification without reasonable doubt.

I can immediately, and reasonably, doubt the output of an LLM, pending verification.

> the metric of how [the uninformed] generally measure intelligence

Court reports should as much be about human sensibility. I have met plenty of high IQ people who were insensitive.

Yeah I certainly associate LLMs with high intelligence when they provide fake links to fake information, I think, man this thing is SMART