Introduction to abstract entropy — LessWrong
In the course of researching optimization, Alex decided that he had to really understand what entropy is. But he found the existing resources (wikipe…
x Introduction to abstract entropy — LessWrong Entropy from first principles Information theory Entropy Logic & Mathematics Physics World Modeling Curated 252 Introduction to abstract entropy by Alex_Altair 20th Oct 2022 21 min read 78 252 This post, and much of the following sequence, was greatly aided by feedback from the following people (among others): Lawrence Chan , Joanna Morningstar , John Wentworth , Samira Nedungadi , Aysja Johnson , Cody Wild , Jeremy Gillen , Ryan Kidd , Justis Mills and Jonathan Mustin . Introduction & motivation In the course of researching optimization, I decide
related reading
- What is Entropy? | Jason Fantljasonfantl.com
- What is Entropy? | Azimuthjohncarlosbaez.wordpress.com
- Visual Information Theory -- colah's blogcolah.github.io
- Reinventing Entropy | Compression is Intelligence Part 1youtube.com
- Study Guide — LessWronglesswrong.com
- Six (and a half) intuitions for KL divergence — LessWronglesswrong.com
- Cross-entropy | Anıl Zenginoğluanilzen.github.io
- Entropy + Algebra + Topology = ?math3ma.com
- Maximum Entropy Distributions | Bounded Rationalitybjlkeng.github.io
- Shtetl-Optimized >> Blog Archive >> The First Law of Complexodynamicsscottaaronson.blog
- The Entropy of A Markov Chainchillphysicsenjoyer.substack.com
- Maximum Entropy Methods (MaxEnt)bactra.org