What is theory without observation? Science was turbocharged once we recognized the need to make testable theories and then actually conduct tests, always ready to toss a theory, no matter how beautiful it was or who came up with it, if it failed the test.

LLM's don't "think" that way. They don't form hypotheses or theories. We may need an entirely new class of AI algorithms to successfully cut humans out of the loop, and that may be a very fortunate thing. The corporations currently at the forefront of AI appear to be riding a wave of gold-fever and are completely lacking in patience or good judgement.