Ah, yes. The "Igon Value Problem": https://youtu.be/wBBnfu8N_J0?t=2097

I was thinking the cautiousness was intentionally bred into LLMs, but it could very well be an artifact of the training data, too.