Neural tangent kernel - Wikipedia
In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent. It allows ANNs to be studied using theoretical tools from kernel methods.
Neural tangent kernel - Wikipedia Jump to content From Wikipedia, the free encyclopedia Type of kernel induced by artificial neural networks In the study of artificial neural networks (ANNs), the neural tangent kernel ( NTK ) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent . It allows ANNs to be studied using theoretical tools from kernel methods . In general, a kernel is a positive-semidefinite symmetric function of two inputs which represents some notion of similarity between the two inputs. The NTK is a specific kernel de
related reading
- Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
- Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
- [1806.07572] Neural Tangent Kernel: Convergence and Generalization in Neural Networksarxiv.org
- Understanding the Neural Tangent Kernel – EigenTalesrajatvd.github.io
- nn-notes.pdfboris-hanin.github.io
- [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
- [2205.09653] Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networksarxiv.org
- Infinite Limits of Neural Networks - Kempner Institutekempnerinstitute.harvard.edu
- A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
- [2007.12826] The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Trainingarxiv.org
- [2304.03408] Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networksarxiv.org
- Greg Yang | Professional pagethegregyang.com