[2009.11732] A Unifying Review of Deep and Shallow Anomaly Detection
Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly detection problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on generative models, one-class classification, and reconstruction, there is a growing need to bring methods of this field into a systematic and unified perspective. In this review we aim to identify the common underlying principles as well as the assumptions that are often made implicitly by various methods. In particular, we draw connections between classic 'shallow' and novel deep approaches and show how this relation might cross-fertilize or extend both directions. We further provide an empirical assessment of major existing methods that is enriched by the use of recent explainability techniques, and present specific worked-through examples together with practical advice. Finally, we outline critical open challenges and identify specific paths for future research in anomaly detection.
Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly detection problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on generative models, one-class classification, and reconstruction, there is a growing need to bring methods of this field into a systematic and unified perspective. In this review we aim to identify the co
Explore this link on the map →related reading
- GitHub - open-edge-platform/anomalib: An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference. · GitHubgithub.com
- A gentle introduction to mechanistic anomaly detection — LessWronglesswrong.com
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- The Decade of Deep Learning | Leo Gaobmk.sh
- Mechanistic anomaly detection and ELK — LessWronglesswrong.com
- Meta Learninglilianweng.github.io
- Concrete empirical research projects in mechanistic anomaly detection — LessWronglesswrong.com
- A gentle introduction to mechanistic anomaly detection — LessWronglesswrong.com
- DP-VAE: Human-Readable Text Anonymization for Online Reviews with Differentially Private Variational Autoencodersweb.archive.org
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- [2606.06624] Principles and Practice of Deep Representation Learning: or a Mathematical Theory of Memoryarxiv.org
- Extending Stein's unbiased risk estimator to train deep denoisers with correlated pairs of noisy imagesproceedings.neurips.cc