Self-Supervised Representation Learning | Lil'Log

[Updated on 2020-01-09: add a new section on Contrastive Predictive Coding]. [Updated on 2020-04-13: add a “Momentum Contrast” section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a “Bisimulation” section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the “Momentum Contrast” section.] [Updated on 2021-05-31: remove section on “Momentum Contrast” and add a pointer to a full post on “Contrastive Representation Learning”]

Table of Contents Why Self-Supervised Learning? Images-Based Distortion Patches Colorization Generative Modeling Contrastive Learning Video-Based Tracking Frame Sequence Video Colorization Control-Based Multi-View Metric Learning Autonomous Goal Generation Bisimulation References [Updated on 2020-01-09: add a new section on Contrastive Predictive Coding ]. [Updated on 2020-04-13: add a "Momentum Contrast" section on MoCo, SimCLR and CURL.] [Updated on 2020-07-08: add a "Bisimulation" section on DeepMDP and DBC.] [Updated on 2020-09-12: add MoCo V2 and BYOL in the "Momentum Contrast" section.]

related reading

• Contrastive Representation Learning | Lil'Loglilianweng.github.io
• The Annotated JEPA | Elements of a Vector Spaceelonlit.com
• pdfopenreview.net
• Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent" (BYOL) - Imbueimbue.com
• [2002.05709] A Simple Framework for Contrastive Learning of Visual Representationsarxiv.org
• Generative modelling in latent space – Sander Dielemansander.ai
• Self-supervised learning - Wikipediaen.wikipedia.org
• A Few Words on Representation Learning - Thalles' blogsthalles.github.io
• [2603.14482] V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningarxiv.org
• The Platonic Representation Hypothesisphillipi.github.io
• LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelsle-wm.github.io
• Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io