Self-supervised learning
Self-supervised learning (SSL) is a paradigm in machine learning where a model is trained on a task using the data itself to generate supervisory signals, rather than relying on externally-provided labels. In the context of neural networks, self-supervised learning aims to leverage inherent structures or relationships within the input data to create meaningful training signals. SSL tasks are designed so that solving them requires capturing essential features or relationships in the data. The input data is typically augmented or transformed in a way that creates pairs of related samples, where one sample serves as the input, and the other is used to formulate the supervisory signal. This augmentation can involve introducing noise, cropping, rotation, or other transformations. Self-supervised learning more closely imitates the way humans learn to classify objects.
Self-supervised learning - Wikipedia Jump to content From Wikipedia, the free encyclopedia Machine learning paradigm Not to be confused with Semi-supervised learning . This article may be too technical for most readers to understand . Please help improve it to make it understandable to non-experts , without removing the technical details. ( July 2025 ) ( Learn how and when to remove this message ) Part of a series on Machine learning and data mining Paradigms Supervised learning Unsupervised learning Semi-supervised learning Self-supervised learning Reinforcement learning Meta-learning Online
Explore this link on the map →related reading
- Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io
- On the Stepwise Nature of Self-Supervised Learning - Imbuegenerallyintelligent.com
- Self-Supervised Representation Learning | Lil'Loglilianweng.github.io
- Self-Adapting Language Modelsarxiv.org
- Self-Labeled Techniques for Semi-Supervised Learning: Taxonomy, Software and Empirical Study | Soft Computing and Intelligent Information Systemssci2s.ugr.es
- Semi-Supervised Learning: Techniques & Examples [2024]v7labs.com
- pdfopenreview.net
- Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent" (BYOL) - Imbueimbue.com
- [2006.07733] Bootstrap your own latent: A new approach to self-supervised Learningarxiv.org
- A Few Words on Representation Learning - Thalles' blogsthalles.github.io
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- [2211.02625] MAEEG: Masked Auto-encoder for EEG Representation Learningarxiv.org