Lecture 7 - Deep Learning Foundations: Neural Tangent Kernels - YouTube

Follow along using the transcript. Follow along using the transcript.

Course Webpage: http://www.cs.umd.edu/class/fall2020/cmsc828W/ All right, let's start. So today we are going to talk about neural tangent kernels. Uh first I'm going to briefly overview you know, the kernel methods and the kernel trick in uh learning and then I'm going to uh talk about uh specifically neural tangent kernels and what are the success and failure stories of them. All right. So let's again start with our favorite learning method which is linear regression. Everything is simple in linear regression. So basically we have a data set with n points x i's and y i's. Let's uh for…

saved by

• Jack Zheng

related reading

• Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
• Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
• Understanding the Neural Tangent Kernel – EigenTalesrajatvd.github.io
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• Yes you should understand backprop | by Andrej Karpathy | Mediumkarpathy.medium.com
• nn-notes.pdfboris-hanin.github.io
• The Little Book of Deep Learningfleuret.org
• CS231n Deep Learning for Computer Visioncs231n.github.io
• A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
• Neural tangent kernel - Wikipediaen.wikipedia.org
• CS231n Deep Learning for Computer Visioncs231n.github.io
• Neural networks and deep learningneuralnetworksanddeeplearning.com