Self-Supervised Representation Learning | Lil'Log

[Updated on 2020-01-09: add a new section on Contrastive Predictive Coding]. [Updated on 2020-04-13: add a “Momentum Contrast” section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a “Bisimulation” section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the “Momentum Contrast” section.] [Updated on 2021-05-31: remove section on “Momentum Contrast” and add a pointer to a full post on “Contrastive Representation Learning”]

Table of Contents Why Self-Supervised Learning? Images-Based Distortion Patches Colorization Generative Modeling Contrastive Learning Video-Based Tracking Frame Sequence Video Colorization Control-Based Multi-View Metric Learning Autonomous Goal Generation Bisimulation References [Updated on 2020-01-09: add a new section on Contrastive Predictive Coding ]. [Updated on 2020-04-13: add a "Momentum Contrast" section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a "Bisimulation" section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the "Momentum Contrast" section.]

related reading

• 2006.10742arxiv.org
• Contrastive Representation Learning | Lil'Loglilianweng.github.io
• The Annotated JEPA | Elements of a Vector Spaceelonlit.com
• d89a66c7c80a29b1bdbab0f2a1a94af8-Paper.pdfproceedings.neurips.cc
• [2002.05709] A Simple Framework for Contrastive Learning of Visual Representationsarxiv.org
• pdfopenreview.net
• Self-supervised learning: The dark matter of intelligenceai.facebook.com
• Decoupling Representation Learning from Reinforcement Learningarxiv.org
• Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent" (BYOL) - Imbueimbue.com
• Generative modelling in latent space – Sander Dielemansander.ai
• Contrastive Learning as Goal-Conditioned Reinforcement Learningarxiv.org
• Self-supervised learning - Wikipediaen.wikipedia.org