logoalt Hacker News

Problem solving using Markov chains (2007) [pdf]

299 pointsby Alifatisk07/30/202598 commentsview on HN

Comments

satvikpendem07/30/2025

I assume OP watched this excellent Veritasium video about Markov and his chains [0] and posted this article which was referenced in that video.

[0] https://youtu.be/KZeIEiBrT_w

show 5 replies
postit07/30/2025

Markov Chains are a gateway drug to more advanced probabilistic graphic models which are worth exploring. I still remember working throughout Koller&Friedman cover to cover as one of the best learning experiences I’ve ever had.

show 2 replies
AnotherGoodName07/30/2025

I feel like we need a video on Dynamic Markov Chains. It's a method to create a markov chain from data. It's used in all the highest compression winners in the Hutter Prize (a competition to compress data the most).

show 2 replies
mindcrime07/30/2025

Heh, somebody watched that same Veritasium video about Markov Chains and Monte Carlo methods. Great video; lots of interesting historical stuff in there that I didn't know (like the feud between Markov and Nekrasov).

show 1 reply
amelius07/30/2025

If you're holding a hammer every problem looks like a nail ...

show 1 reply
nyeah07/30/2025

I mean, often, sure. Also problem solving is often a matter of making a spreadsheet full of +, -, *, / operations. Problem solving is often a matter of counting permutations and combinations. It's often a matter of setting up the right system of ordinary differential equations. It's often a matter of setting up the right linear algebra problem.

It's often a matter of asking the right person what technique works. It's often a matter of making a measurement before getting lost in the math. It's often a matter of finding the right paper in the literature.

1vuio0pswjnm707/31/2025

Note to file: No one is complaining about the absence of [PDF] from the title. Possible that time of submission is a factor.

For example, https://news.ycombinator.com/item?id=44574033

show 1 reply
naasking07/30/2025

Unless the problem is "quantum mechanics", then that reduces to non-Markovian processes with unistochastic laws, and ironically, this makes for a causally local QM:

https://arxiv.org/abs/2402.16935v1

theturtletalks07/30/2025

The Veritasium video brought up an interesting point about how LLMs, if trained too much on their own content, will fall victim to the Markov Chain and just repeat the same thing over and over.

Is this still possible with the latest models being trained on synthetic data? And if it possible, what would that one phrase be?

show 1 reply
Pamar07/30/2025

I am on the move so I cannot check the video (but I did skim the pdf). Is there any chance to see an example of this technique? Just a toy/trivial example would be great, TIA!

show 1 reply
stevenAthompson07/30/2025

Here's a direct link to a PDF.

http://math.uchicago.edu/~shmuel/Network-course-readings/Mar...

show 1 reply
tantalor07/30/2025

(2007)

show 1 reply