That's because LLMs are incoherent by design, and need extensive guardrails to be useful for tasks that demand coherence.
I share a similar experience with bug finding; I think it also helps that LLMs can simply hold much more context at once than a human, as seeing a much larger portion of the codebase simultaneously makes it much easier to spot discrepancies.