logoalt Hacker News

christina9710/12/20241 replyview on HN

I feel like just doing simulated annealing on the starting grid would work better and be faster to implement?

(Not saying the goal was working well and being fast to implement.)


Replies

versteegen10/12/2024

Simulated annealing (basically MCMC sampling with a temperature schedule) is how you optimise or sample the equivalent MRF, which I discussed in my other comment. You can hope to escape local minima using annealing, and lower the temperature to zero to fall into a local minima, minimising the noise added by annealing. In practice if you're trying to produce something that looks like a target image as in the article I'm pretty sure the results will be indistinguishable. If you actually cared about how many individual pixels are correct, yes, annealing is better than gradient descent. That's why stochastic gradient descent is used in ML.