alt Hacker News> what are its shortcomings that are impossible to overcome because physics won't allow.
Have you intended to say "because reasons"? There should be a long chain of reasoning connecting "LLMs will never be able to strictly follow instructions written in natural language (as agreed by 90% consensus of experts or some such, because you can't formally verify adherence to informal natural language instructions)" and "physics doesn't allow that." And I can't find it anywhere. Neither in your comment history, nor in literature.
Because it is next token predictions and there is no logical part into that. It is like saying I cannot find any research paper on the fact that car collusion might cause fire because gasoline is in the tank.
But the fact is that there's plenty of literature out there on hallucination and unreliability of LLMs already. If you know otherwise, let us inform Dario before next funding round.