So how often is this LLM wrong?
Developers shouldn't have to waste their time to figure this out.
Every time its use insults (in aggregate) invaluable human contributors. It doesn't even matter if they're philosophically "correct" or not: it's about respect.
I think this the wrong question to ask. The original complaint suggests that llm setup used is largely unknown in terms of how it organized. For all you know, it may be splitting and sending different requests to unpaid gemini, local 8b qwen or paid claude/astra. None of it is known, listed or noted as expected to be somewhat stable.
The question is not even about the setup in terms of hardware/software. The question is about organizational structuring of its processes.