Variational autoencoders.
A variational autoencoder (VAE) provides a probabilistic manner for describing an observation in latent space. Thus, rather than building an encoder which outputs a single value to describe each latent state attribute, we'll formulate our encoder to describe a probability distribution In my introductory post on autoencoders, I discussed various models (undercomplete, sparse, denoising, contractive) which take data as input and discover some latent state representation of that data. More specifically, our input data is converted into an encoding vector where each dimension represents some learned attribute about the data. The most important detail to grasp here is that our encoder network is outputting a single value for each encoding dimension. The decoder network then subsequently takes these values and attempts to recreate the original input. A variational autoencoder (VAE) provides a probabilistic manner for describing an observation in latent space. Thus, rather than building an en
In my introductory post on autoencoders, I discussed various models (undercomplete, sparse, denoising, contractive) which take data as input and discover some latent state representation of that data. More specifically, our input data is converted into an encoding vector where each dimension represents some learned attribute about the data. The most important detail to grasp here is that our encoder network is outputting a single value for each encoding dimension. The decoder network then subsequently takes these values and attempts to recreate the original input. A variational autoencoder (VA
Explore this link on the map →saved by
related reading
- Difference between AutoEncoder (AE) and Variational AutoEncoder (VAE) | Towards Data Sciencetowardsdatascience.com
- Tutorial - What is a variational autoencoder? – Jaan Lı 李jaan.io
- Variational autoencoder - Wikipediaen.wikipedia.org
- Variational AutoEncoders (VAE) with PyTorch - Alexander Van de Kleutavandekleut.github.io
- From Autoencoder to Beta-VAE | Lil'Loglilianweng.github.io
- Understanding VQ-VAE (DALL-E Explained Pt. 1)mlberkeley.substack.com
- machine learning - Is the output of a variational autoencoder meant to be a distribution that can be sampled, or a sample directly? - Cross Validatedstats.stackexchange.com
- Jupyter Notebook Viewernbviewer.org
- Generative modelling in latent space – Sander Dielemansander.ai
- Autoencoder - Wikipediaen.wikipedia.org
- Diffusion Models as a kind of VAE | Angus Turnerangusturner.github.io
- [1904.01277] A PCA-like Autoencoderarxiv.org