That would be the physically embodied definition. Which is a useful starting point, because clearly our consciousness is physically embodied, while an LLM's isn't.

This matters more than it seems, because we're not calculators, and we're not just brains. There are proven links between mental and emotional states and - for example - the gut biome.

https://www.nature.com/articles/s41598-020-77673-z

There's a huge amount going on before we even get to the language parts.

As for Dawkins - as someone on Twitter pointed out, the man who devoted his life to telling people believers in sky fairies they were idiots has now persuaded himself there's a genie living inside a data centre, because it tells him he's smart.

If he'd actually understood critical thinking instead of writing popular books about it he wouldn't be doing this.

There are times I am feeling neither pain nor pleasure, but I am still experiencing conciousness.

So that definition seems to fail immediately.

And how do you even measure pain, is it painful for an LLM to be reprimanded after generating a reply the user doesn't like? It seems to act like it.

And how do you define pain and pleasure? Do insects feel pain?