✳flâneur — a map of the web's best reading
A Maximum Entropy Intuition for Fundamental Statistical Distributions | long intuition
longintuition.com · 3,149 words · saved by 1 readers
Imagine you wake up tomorrow in an empty white room, a la The Matrix. You don’t remember how you got there. Anything can happen.
Imagine you wake up tomorrow in an empty white room, a la The Matrix. You don’t remember how you got there. Anything can happen. If Keanu Reeves appears, you’d probably think this is related in some way to the Matrix. If Keanu appears and then Laurence Fishburne (Morpheus) appears, you’d think—okay, this is almost definitely related to the Matrix. On the other hand, if Obama and Clinton appear in your white room, in your head, you’d think, okay, the Matrix-related possibilities are less likely; the politics-related possibilities are more likely, whatever those are. For the first few seconds in
Explore this link on the map →saved by
related reading
- Maximum Entropy Distributions | Bounded Rationalitybjlkeng.github.io
- Maximum Entropy Methods (MaxEnt)bactra.org
- Principle of maximum entropy - Wikipediaen.wikipedia.org
- Visual Information Theory -- colah's blogcolah.github.io
- Kullback–Leibler divergence - Wikipediaen.wikipedia.org
- Six (and a half) intuitions for KL divergence — LessWronglesswrong.com
- Boltzmann distribution - Wikipediaen.wikipedia.org
- A Mathematical Theory of Communicationpeople.math.harvard.edu
- Poisson distribution - Wikipediaen.wikipedia.org
- Prior probability - Wikipediaen.wikipedia.org
- Visual Information Theory -- colah's blogcolah.github.io
- An Introduction to Fisher Information – Awni Hannun – Writing About Machine Learningawni.github.io