“Technology that is based on everything humanity has already done, fails to do things that humanity has not yet done”
Are you following the news?
https://news.ycombinator.com/item?id=48863490
LLMs don't just 'average' their data.
This may seem so blatantly obvious to us that it need not be mentioned, but to a lot of people I bet it is not obvious at al, and in fact may even be counter-obvious.
Wasn't Einstein's discoveries based on things humanity had already done?
AIs do things no human has done before millions of times a day.