Zero-Shot Knowledge Distillation in Deep Networks

N/A

Zero-Shot Knowledge Distillation in Deep Networks Gaurav Kumar Nayak * 1 Konda Reddy Mopuri * 2 Vaisakh Shaj * 3 R. Venkatesh Babu 1 Anirban Chakraborty 1 Abstract limited resource environments or when real-time inference Knowledge distillation deals with the problem of is expected. On the…

saved by

• Yu G

related reading

• Learning 3D object-centric representation through predictionarxiv.org
• NL.pdfabehrouz.github.io
• The Decade of Deep Learning | Leo Gaobmk.sh
• Distillation Walkthroughvladfeinberg.com
• Nitrobrew: Fast, Lossless Distillation for Free | Tildeblog.tilderesearch.com
• The Little Book of Deep Learningfleuret.org
• [1706.04599] On Calibration of Modern Neural Networksarxiv.org
• Understanding deep learning requires rethinking generalizationarxiv.org
• Everything You Need to Know about Knowledge Distillationhuggingface.co
• Deep Knowledge Tracingstanford.edu
• [1511.03643] Unifying distillation and privileged informationarxiv.org
• [2605.01172] A Theory of Generalization in Deep Learningarxiv.org