alt Hacker News> Eventually it will run out of things that it can do with its training and the only way to get it to do more will be training it on new human found knowledge.
How do you know this?
Replies
izzydata • today at 2:57 PM
I don't see how its output possibilities could be infinite given a finite set of data. Taken to the extreme if you give an LLM only a single piece of information then that is going to be the only thing it can produce. Given it two pieces of information and maybe it can produce every combination of those two things. Given all of the worlds knowledge I'm sure its possible outputs are incomprehensibly large, but still not infinite. Then having its outputs match a set of really specific instructions is going to be a small subset of that.
➕ show 5 replies
AIs cannot invent things like cubism, surrealism or hip-hop.
Or maybe it can; the early image generators famously did output horrific images sometimes because of their limitations, but these outputs qualify nonetheless creations.
Now the interesting thing is that it is humans who evaluate them as horrific, worthless or interesting.
Certainly AIs could pretend they have that sort of opinions and judgement, but hopefully humans will remain more interested in the opinions of other humans.