[2006.05278] An Overview of Deep Semi-Supervised Learning

Deep neural networks demonstrated their ability to provide remarkable performances on a wide range of supervised learning tasks (e.g., image classification) when trained on extensive collections of labeled data (e.g., ImageNet). However, creating such large datasets requires a considerable amount of resources, time, and effort. Such resources may not be available in many practical cases, limiting the adoption and the application of many deep learning methods. In a search for more data-efficient deep learning methods to overcome the need for large annotated datasets, there is a rising research interest in semi-supervised learning and its applications to deep neural networks to reduce the amount of labeled data required, by either developing novel methods or adopting existing semi-supervised learning frameworks for a deep learning setting. In this paper, we provide a comprehensive overview of deep semi-supervised learning, starting with an introduction to the field, followed by a summarization of the dominant semi-supervised approaches in deep learning.

View PDF HTML (experimental) Abstract:Deep neural networks demonstrated their ability to provide remarkable performances on a wide range of supervised learning tasks (e.g., image classification) when trained on extensive collections of labeled data (e.g., ImageNet). However, creating such large datasets requires a considerable amount of resources, time, and effort. Such resources may not be available in many practical cases, limiting the adoption and the application of many deep learning methods. In a search for more data-efficient deep learning methods to overcome the need for large…

saved by

• Fernando Silva

related reading

• Semi-Supervised Learning: Techniques & Examples [2024]v7labs.com
• Self-Labeled Techniques for Semi-Supervised Learning: Taxonomy, Software and Empirical Study | Soft Computing and Intelligent Information Systemssci2s.ugr.es
• [2103.03230] Barlow Twins: Self-Supervised Learning via Redundancy Reductionarxiv.org
• What Is Semi-Supervised Learning - MachineLearningMastery.commachinelearningmastery.com
• Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io
• Big Self-Supervised Models are Strong Semi-Supervised Learnersarxiv.org
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• Understanding Deep Learningudlbook.github.io
• The Decade of Deep Learning | Leo Gaobmk.sh
• Deep Learningdeeplearningbook.org
• Self-supervised learning: The dark matter of intelligenceai.facebook.com
• [1801.07606] Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningarxiv.org