It is a good post, but is missing the connection to continuous normalizing flows. Diffusion models, flow matching, consistency models are biased approximations of continuous normalizing flows (which themselves have some slight biases, but less). Adversarial losses can somewhat help with bias (e.g. RL, GANs), but training those has issues.
by wwarner
0 subcomment
Haven't finished this but for me it's so refreshing to read some science on deep learning and not just weird predictions.
Does anyone have good resources into a more practical approach toward building diffusion models? I found the book by Rashka for Building an LLM from Scratch really helpful in understanding a lot of concepts behind LLMs, and I am looking for a similar resource for diffusion models
by darshanmakwana
3 subcomments
This is way outside of my expertise, can anyone given a TL;DR or ai;dr?
Hacker News