✳flâneur — a map of the web's best reading
Learning the integral of a diffusion model – Sander Dieleman
sander.ai · 17,454 words · saved by 3 readers
A deep dive on flow maps.
Sampling from a diffusion model is an iterative process: at each step, the denoiser estimates the tangent direction to a path through input space. We move along this path by repeatedly taking small steps in this direction, effectively calculating an integral across noise levels . This gradually transforms samples from a simple noise distribution into samples from a target distribution, and traces out the path that connects them. Can we train neural networks to directly predict this integral instead, in order to speed up sampling? Yes we can – welcome to the world of flow maps ! Ever since the
Explore this link on the map →saved by
related reading
- Diffusion Meets Flow Matchingdiffusionflow.github.io
- Step-by-Step Diffusion: An Elementary Tutorialarxiv.org
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- [2406.08929] Step-by-Step Diffusion: An Elementary Tutorialar5iv.labs.arxiv.org
- How to Generate Text in One Stepone-step-lm.github.io
- 2409.02908arxiv.org
- Diffusion models from scratchchenyang.co
- Calculus on Computational Graphs: Backpropagation -- colah's blogcolah.github.io
- The Principles of Diffusion Modelsarxiv.org
- The Principles of Diffusion Modelsarxiv.org
- Diffusion model - Wikipediaen.wikipedia.org
- ⭐️ Diffusion Modelsandrewkchan.dev