logoalt Hacker News

SigmundA • yesterday at 7:58 PM • 1 reply • view on HN

I read Blindsight long before modern LLM AI came about and at the time I thought the aliens being intelligent without being conscious was fascinating and gave me a different perspective that those things could be separated but it didn't have and direct application.

Learning how modern AI's respond immediately made me think about how Rorschach was communicating with the crew and how current LLM AI's might be considered intelligent while not conscious.

https://en.wikipedia.org/wiki/Blindsight_(Watts_novel)#Consc...

Replies

throw310822 • today at 9:23 AM

How do you even know that LLMs are not conscious?

I've just skimmed the Wikipedia entry you linked:

  the linguist realizes that the alien creatures cannot be, in fact, conscious because of their lack of semantic understanding:

  "Our cousins lie about the family tree," Sascha replied, "with nieces and nephews and Neanderthals. We do not like annoying cousins."
  "We'd like to know about this tree."
  Sascha muted the channel and gave us a look that said Could it be any more obvious? "It couldn't have parsed that. There were three linguistic ambiguities in there. It just ignored them."
So it turns out I'm not conscious either and incapable of semantic understanding, because I've ignored the ambiguities too. Though note that parsing ambiguous sentences used to be exactly what pre-LLM AIs could not do, and what we thought of as requiring real understanding. The exact opposite of what Watts seems to claim.
➕ show 1 reply