A Few Words on Representation Learning - Thalles' blog
In the last two decades, the field of Artificial Intelligence (AI) has seen substantial development in research and industrial applications. Machine learning algorithms such as Logistic Regression and Naive Bayes can recognize patterns from a set of features and solve problems that seemed otherwise impossible to be solved by hard-coding knowledge into expert systems. These shallow learning algorithms can perform relatively complex tasks such as product recommendation or learn to distinguish between spam from not-spam emails. More interesting, the performance of these shallow machine learning algorithms massively depends on the representations they receive as input. For instance, if we decide to build a spam email detector using Naive Bayes, passing a large body of raw unstructured email data to the classifier will not help. Instead, we need to find a different way to represent the text before feeding it to the classifier. Notably, one commonly used text representation for this kind of
Source Image: Introducing Activation Atlases Introduction In the last two decades, the field of Artificial Intelligence (AI) has seen substantial development in research and industrial applications. Machine learning algorithms such as Logistic Regression and Naive Bayes can recognize patterns from a set of features and solve problems that seemed otherwise impossible to be solved by hard-coding knowledge into expert systems. These shallow learning algorithms can perform relatively complex tasks such as product recommendation or learn to distinguish between spam from not-spam emails. More intere
Explore this link on the map →related reading
- Self-Supervised Representation Learning | Lil'Loglilianweng.github.io
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- Theoretical Motivations for Deep Learning | Rinu Boneyrinuboney.github.io
- Deep Learning, NLP, and Representations - colah's blogcolah.github.io
- [2103.00020] Learning Transferable Visual Models From Natural Language Supervisionarxiv.org
- Machine learning - Wikipediaen.wikipedia.org
- 07-representation-learning.pdfweb.stanford.edu
- The Platonic Representation Hypothesisphillipi.github.io
- Self-supervised learning - Wikipediaen.wikipedia.org
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- Contrastive Representation Learning | Lil'Loglilianweng.github.io
- [2002.05709] A Simple Framework for Contrastive Learning of Visual Representationsarxiv.org