alt Hacker NewsYea, if it were true, then Markov chains on steroids (LLMs) would be super at problem solving, but they can't even reason. And they get worse if you add random facts about cats: https://news.ycombinator.com/item?id=44724238
Replies
_Algernon_ • 07/31/2025
LLMs aren't Markov chains unless they have a context window of 1.
>In probability theory and statistics, a Markov chain or Markov process is a stochastic process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event
➕ show 1 reply
ducktective • 07/30/2025
LLMs are Markov Chains on steroids?
By the way, does anyone know which model or type of model was used in winning gold in IMO?
➕ show 3 replies
That doesn’t follow at all, but I guess don’t pass up any opportunity to bash LLMs.