For many of us the release of GPT-3 appeared like a huge step function, a gigantic leap forward, but the fact is, it wasn't that huge. We've been researching computers and AI for around 70 years now. We had productive "machine learning" and pattern completion for a good what, 10 or 15 years before GPT-3 was released. Your phone could auto complete. Computers could win at chess. I worked on working autonomous flying drones back in 2008. In 2020 I joined an autonomous car company that had been slowly grinding for 10 years beforeI joined. The growth is there but not at the blinding rate you think.
One thing I have seen no evidence of is AI being smarter than the smartest humans. It's still just a search engine (with an impressive human language UI) of existing human knowledge. It cannot do anything it has not been trained on.
[dead]
In what sense is an LLM analogous (much less reducible to) a search engine?