logoalt Hacker News

cyanregimenttoday at 3:05 PM1 replyview on HN

Even within your own brain, conveyance != experience.

When you report on your own experiences - like the warmth of the sun - that report is not itself the experience.

The scary part about an LLM (p-zombie) is that it can report on an experience exactly the same as if it had one, and for all intents and purposes it'd be sufficient for the task at hand.

After all, I don't need to have your experiences to know what you mean.


Replies

un-diletantetoday at 3:24 PM

I agree with conveyance != experience, and looking at it again I agree with your original statement with regards to the "!=". But I do believe that conveying experience requires having it.

By conveying, I don't mean conveying the idea of a possible experience, but conveying knowledge about a real experience that a real experiencer had. What is conveyed is not the entire experience which is impossible, what is conveyed is knowledge that is sensible to someone who has similar experiences they can associate it to.

If the report does not correspond to an underlying experience, then it's just a lie. Like if I say to someone "Thank you" after they do me a favor, they perceive that I am having the experience of gratitude. But if I am not really grateful, then my words haven't conveyed information about an actual experience, about an actual instance of an experience.

So I'd say the report + the report's correspondence to reality + the receiver's ability to understand the report based on their own experiences = conveyance.

I do not consider a false report that leads the receiver to imagine the existence of a non-existent experience to be "conveyance of an experience".

show 1 reply