Self-Supervised Representation Learning | Lil'Log
[Updated on 2020-01-09: add a new section on Contrastive Predictive Coding]. [Updated on 2020-04-13: add a “Momentum Contrast” section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a “Bisimulation” section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the “Momentum Contrast” section.] [Updated on 2021-05-31: remove section on “Momentum Contrast” and add a pointer to a full post on “Contrastive Representation Learning”]
Table of Contents Why Self-Supervised Learning? Images-Based Distortion Patches Colorization Generative Modeling Contrastive Learning Video-Based Tracking Frame Sequence Video Colorization Control-Based Multi-View Metric Learning Autonomous Goal Generation Bisimulation References [Updated on 2020-01-09: add a new section on Contrastive Predictive Coding ]. [Updated on 2020-04-13: add a "Momentum Contrast" section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a "Bisimulation" section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the "Momentum Contrast" section.]
related reading
- Contrastive Representation Learning | Lil'Loglilianweng.github.io
- Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io
- A (Long) Peek into Reinforcement Learning | Lil'Loglilianweng.github.io
- Lil'Loglilianweng.github.io
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent" (BYOL) - Imbueimbue.com
- Policy Gradient Algorithms | Lil'Loglilianweng.github.io
- [2002.05709] A Simple Framework for Contrastive Learning of Visual Representationsarxiv.org
- Decoupling Representation Learning from Reinforcement Learningarxiv.org
- Contrastive Learning as Goal-Conditioned Reinforcement Learningarxiv.org
- Big Self-Supervised Models are Strong Semi-Supervised Learnersarxiv.org
- d89a66c7c80a29b1bdbab0f2a1a94af8-Paper.pdfproceedings.neurips.cc