I don't know about that. When you're prompting some LLM, the response you get is a statistically likely valid response to the prompt. Whether it contains any truth or facts or information at all is besides the point; the LLM has done its job of predicting something that is statistically likely to be the answer.
The fact that people assign any weight to that information is the mistake.
> Whether it contains any truth or facts or information at all is besides the point
The definition of bullshit in the original article was precisely this: no care given to whether there is truth in what is said.