alt Hacker NewsHow can their internal representation represent "concepts" when the training data is all words? There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff.
Replies
sebastiennight • today at 5:42 PM
This is a wild argument.
If I use the word "semantic", do you have a concept of what it means?
If so, can you please share which of your senses have shaped the world experience that inform this concept? What have you smelled, tasted, caressed, that informed this concept outside of words?
If I make up the word "polysemantic", do you need to recall a personal experience of polyamory to understand it, or could you possibly use your concept of "poly" and your concept of "semantic" to figure out this new concept?
➕ show 1 reply
> There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff.
The brain too sits locked inside a bone box and only gets a bundle of unlabeled nerves connecting it to the outside. How can the brain could possibly experience anything, it only sees patters and patterns of patterns never the real thing?