alt Hacker NewsI think the problem here is that LLMs aren’t really “intelligence models” but more like “knowledge models”. LLMs don’t “think”, they just use a clever trick to make it seem like they do. I might not understand a lot about current state of AI, but that’s what they seem to be. Give it information and ask to organise it and make links, and they’ll do it, but that’s it, they don’t continually try to get out of the knowledge box they’re at, they don’t even know there’s a box.
Replies
I frame it as a document extender trained on other documents. Any "mind" we perceive is an illusion in our heads as we experience a story about a character, and the "intelligence" is reflected at us back out of our collective writings.
I can make a program that writes a stories involving Santa Claus, and I can make another program that takes the hidden script and performs certain lines... but at the end of the day I have not made him real.
Feels like a distinction without a difference. What is any intelligence but a sum of its knowledge?
When you watch it solve complex problems and use the browser and do internet searches, and use the entire surface area of the console tools on a linux box every day the idea that there are no major Homomorphisms with biological thinking is just completely out of the question.
I also never understand what the difference between a thinking trick, and "real" thinking is supposed to be.