logoalt Hacker News

Learning the Integral of a Diffusion Model

97 pointsby benanneyesterday at 6:46 PM18 commentsview on HN

Comments

oliverx0yesterday at 11:13 PM

Does anyone have good resources into a more practical approach toward building diffusion models? I found the book by Rashka for Building an LLM from Scratch really helpful in understanding a lot of concepts behind LLMs, and I am looking for a similar resource for diffusion models

show 2 replies
programjamesyesterday at 9:48 PM

It is a good post, but is missing the connection to continuous normalizing flows. Diffusion models, flow matching, consistency models are biased approximations of continuous normalizing flows (which themselves have some slight biases, but less). Adversarial losses can somewhat help with bias (e.g. RL, GANs), but training those has issues.

show 2 replies
darshanmakwanayesterday at 7:50 PM

This is way outside of my expertise, can anyone given a TL;DR or ai;dr?

show 3 replies