> Where the humans aren't omniscient it fills the blanks with nonsense

As do most humans. People lie. People make things up to look smart. People fervently believe things that are easily disproved. Some people are willfully ignorant, anti-science, anti-education, etc.

The problem isn't the transformer architecture... it is the humans who advertise capabilities that are not there yet.