logoalt Hacker News

bloppeyesterday at 4:48 AM1 replyview on HN

I think Nagel put it best in 1974: https://www.philosopher.eu/others-writings/nagel-what-is-it-...

Essentially, something is conscious iff "there is something that it is like to be" that thing. Some people find that completely unsatisfying, some people think it's an insight of utter genius. I'm more in the latter camp.

Also, I think consciousness is non-binary. Something could be semi-conscious, or more or less conscious than something else.

Anyway, I don't think that there's anything that it's like to be an LLM. I don't see how anybody who knows how they actually work could think that.


Replies

lbrandyyesterday at 6:23 AM

> Anyway, I don't think that there's anything that it's like to be an LLM. I don't see how anybody who knows how they actually work could think that.

While I have almost zero belief that LLMs are conscious, I just don't think this is so trivially asserted.

The easy half of this is thinking that LLMs aren't conscious given what we know about how they work. The hard part (and very, very famously so) is explaining how _you_ are conscious given what we know about how you work. You can't ignore the second half of this problem when making statements like this... because many of the obvious ways to argue that clearly LLMs aren't conscious would also apply to you.

show 1 reply