The Reparameterization Trick
gregorygundersen.com · 3,119 words · saved by 1 readers
Gregory Gundersen is a quantitative researcher in New York.
The Reparameterization Trick --> Home Blog RSS The Reparameterization Trick A common explanation for the reparameterization trick with variational autoencoders is that we cannot backpropagate through a stochastic node. I provide a more formal justification. Published 29 April 2018 Informal justifications In Auto-Encoding Variational Bayes , (Kingma & Welling, 2013) , Kingma presents an unbiased, differentiable, and scalable estimator for the ELBO in variational inference. A key idea behind this estimator is the reparameterization trick . But why do we need this trick in the first place? When f
related reading
- 2403.18103.pdfarxiv.org
- Tutorial - What is a variational autoencoder? – Jaan Lı 李jaan.io
- Mediumandacdemir-94699.medium.com
- [1906.02691] An Introduction to Variational Autoencodersarxiv.org
- 1312.6114.pdfarxiv.org
- Tutorial on Variational Autoencodersarxiv.org
- Bayesian Neural Networkscs.toronto.edu
- Difference between AutoEncoder (AE) and Variational AutoEncoder (VAE) | Towards Data Sciencetowardsdatascience.com
- Approximating KL Divergencejoschu.net
- Variational autoencoder - Wikipediaen.wikipedia.org
- Log-derivative trickandrewcharlesjones.github.io
- Diffusion Models as a kind of VAE | Angus Turnerangusturner.github.io