[1606.05908] Tutorial on Variational Autoencoders
In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function approximators (neural networks), and can be trained with stochastic gradient descent. VAEs have already shown promise in generating many kinds of complicated data, including handwritten digits, faces, house numbers, CIFAR images, physical models of scenes, segmentation, and predicting the future from static images. This tutorial introduces the intuitions behind VAEs, explains the mathematics behind them, and describes some empirical behavior. No prior knowledge of variational Bayesian methods is assumed.
View PDF HTML (experimental) Abstract:In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function approximators (neural networks), and can be trained with stochastic gradient descent. VAEs have already shown promise in generating many kinds of complicated data, including handwritten digits, faces, house numbers, CIFAR images, physical models of scenes, segmentation, and predicting the future from static images. This tutorial…
saved by
related reading
- Tutorial - What is a variational autoencoder? – Jaan Lı 李jaan.io
- Difference between AutoEncoder (AE) and Variational AutoEncoder (VAE) | Towards Data Sciencetowardsdatascience.com
- [1906.02691] An Introduction to Variational Autoencodersarxiv.org
- Bayesian Neural Networkscs.toronto.edu
- Variational autoencoders.jeremyjordan.me
- arxiv.org/pdf/1805.08522arxiv.org
- Variational autoencoder - Wikipediaen.wikipedia.org
- Understanding VQ-VAE (DALL-E Explained Pt. 1)mlberkeley.substack.com
- An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
- Diffusion Models as a kind of VAE | Angus Turnerangusturner.github.io
- Adversarial Autoencodersarxiv.org
- 2403.18103.pdfarxiv.org