But isnt the point that it did roll a 17. And no one knows exactly how (in the case of LLMs)? Therefor any description of the conclusion should be thought of as an anology. Decided, randomly accessed, etc.
If nobody knows exactly how, then "at random" sounds about right and the results should be treated as such.
That is, in this case, it should not be used to influence decisions that can start a war.
Try "Emitted".
That's what it did, with no analogy needed.
(But, to be the devil's advocate: the fake can be said about the output of anyone participating here.)
It's actually no different for dice than for LLMs. Explaining accurately the reason for the exact outcome of any given dice roll someone makes would be stupendously hard. It would require lots of instrumentation and math and be poorly transferrable to another surface, another player, etc.
But even so people don't say that we don't understand how dice work.
Saying that we don't understand how LLMs work is exactly like saying we don't understand how dice, or tires, or golf ball shots work. Or like the old myth that we don't understand how bumblebees fly.