Neural tangent kernel - Wikipedia
In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent. It allows ANNs to be studied using theoretical tools from kernel methods.
Neural tangent kernel - Wikipedia Jump to content From Wikipedia, the free encyclopedia Type of kernel induced by artificial neural networks In the study of artificial neural networks (ANNs), the neural tangent kernel ( NTK ) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent . It allows ANNs to be studied using theoretical tools from kernel methods . In general, a kernel is a positive-semidefinite symmetric function of two inputs which represents some notion of similarity between the two inputs. The NTK is a specific kernel de
Explore this link on the map →related reading
- Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
- Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
- [1806.07572] Neural Tangent Kernel: Convergence and Generalization in Neural Networksarxiv.org
- Understanding the Neural Tangent Kernel – EigenTalesrajatvd.github.io
- [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
- A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
- Infinite Limits of Neural Networks - Kempner Institutekempnerinstitute.harvard.edu
- Greg Yang | Professional pagethegregyang.com
- [2304.03408] Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networksarxiv.org
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- Neural network training makes beautiful fractals | Jascha’s blogsohl-dickstein.github.io
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org