Copy of [0.5] GANs & VAEs (exercises).ipynb - Colaboratory
Please send any problems / bugs on the #errata channel in the Slack group, and ask any questions on the dedicated channels for this chapter of material. Today, we're studying two important classes of generative image models: Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs). Although these generally aren't SOTA any more (thanks in part to the rise of diffusion models), there are some deep conceptual insights which can be gleaned from studying these models (VAEs in particular) which help lay the groundwork for more advanced models. These exercises will also hopefully bring much of this chapter full-circle: We start with some reading material on GANs and transposed convolutions (which are often used in parallel with convolutions, to take a latent space and map it back into a full-size image). Next, you'll actually implement and train your own GANs, to generate celebrity pictures. By the time you're done, you'll hopefully have produced output like this (and you'll
Google Colab Sign in
related reading
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- Tutorial - What is a variational autoencoder? – Jaan Lı 李jaan.io
- Tutorial on Variational Autoencodersarxiv.org
- Generative modelling in latent space – Sander Dielemansander.ai
- A Gentle Introduction to Generative Adversarial Networks (GANs) - MachineLearningMastery.commachinelearningmastery.com
- GitHub - Newmu/dcgan_code: Deep Convolutional Generative Adversarial Networks · GitHubgithub.com
- Google Colabcolab.research.google.com
- Understanding Deep Learningudlbook.github.io
- GenAI Handbookgenai-handbook.github.io
- Understanding VQ-VAE (DALL-E Explained Pt. 1)mlberkeley.substack.com
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- What are Diffusion Models?lilianweng.github.io