logoalt Hacker News

famouswafflesyesterday at 10:32 PM3 repliesview on HN

LLMs are not Markov Chains unless you contort the meaning of a Markov Model State so much you could even include the human brain.


Replies

chpatricktoday at 12:07 AM

Not sure why that's contorting, a markov model is anything where you know the probability of going from state A to state B. The state can be anything. When it's text generation the state is previous text to text with an extra character, which is true for both LLMs and oldschool n-gram markov models.

show 2 replies
sophrosyne42yesterday at 11:00 PM

Well LLMs aren't human brains, unless you contort the definition of matrix algebra so much you could even include them.

show 1 reply