✳flâneur — a map of the web's best reading
Kullback–Leibler divergence
en.wikipedia.org · 14,354 words · saved by 9 readers
In mathematical statistics, the Kullback–Leibler (KL) divergence (also called relative entropy and I-divergence), denoted
Kullback–Leibler divergence - Wikipedia Jump to content From Wikipedia, the free encyclopedia Mathematical statistics distance measure "Information gain" redirects here. For information gain in decision trees, see Information gain (decision tree) . In mathematical statistics , the Kullback–Leibler ( KL ) divergence (also called relative entropy and I-divergence ), [ 1 ] denoted D KL ( P ∥ Q ) {\displaystyle D_{\text{KL}}(P\parallel Q)} , is a type of statistical distance : a measure of how much an approximating probability distribution Q is different from a true probability dist
Explore this link on the map →saved by
related reading
- Six (and a half) intuitions for KL divergence — LessWronglesswrong.com
- Visual Information Theory -- colah's blogcolah.github.io
- blog.alexalemi.com Why KL?blog.alexalemi.com
- Short Notes on Divergence Measuresdanilorezende.com
- Approximating KL Divergencejoschu.net
- Exponential families from a single KL identityarxiv.org
- A Gentle Introduction to Cross-Entropy for Machine Learning - MachineLearningMastery.commachinelearningmastery.com
- Reddit - Please wait for verificationreddit.com
- Visual Information Theory -- colah's blogcolah.github.io
- Andy Jonesandrewcharlesjones.github.io
- Gibbs' inequality - Wikipediaen.wikipedia.org
- blog.alexalemi.com KL is All You Needblog.alexalemi.com