Again, you're taking a shortcut. "Markov chain" as an excuse to declare "no intelligence".
It would be much more honest to say "LLMs are not intelligent because I don't want them to be". Would also explain why you overlook the ever-mounting pile of tasks that were thought to require intelligence, and that LLMs now casually beat an average (presumably intelligent) human at.
If you go around believing all things no one has disproved yet, you will have a very busy belief system.