There's a provocative argument raised in the article that I disagree with:

1. DeepFakes, generative image/video/AlphaFold type AIs are not conscious

2. LLMs are generative AI trained on human text samples

3. LLMs are not conscious, and LLMs just seem-to-be conscious

I might argue instead that (2)-> destroys (1), that in fact we should consider even sensory generative AI are somewhat conscious. That is, Chiang's argument also flows in reverse. Or I might argue text samples (2) are so rich in conscious expression that the same process of training really does produce a conscious machine (through some kind of emergence and complexity.)

Either way his simplistic argument falls apart, and/but the crux of the piece falls on getting basics like this correct.