Are you following the news?
https://news.ycombinator.com/item?id=48863490
LLMs don't just 'average' their data.
They interpolate data in an XYZ dimensional space. The implications of that is beyond our comprehension.
I have a hard time believing that all novel concepts yet to be discovered are contained within that space, though.
That doesn't disagree with this article. Proving a theorem that a human already proposed in an existing discipline of math - math, the most formalized and easiest discipline to involve computers in even before LLMs - is very different from expanding the boundaries of science.