The problem is that we don’t have a good understanding of what “thinking” really is, and those parts of it we think we do understand involve simple things done at scale (electrical pulses on specific pathways, etc).

It is not unreasonable to suspect differences between humans and LLMs are differences in degree, rather than category.