Introduction to abstract entropy — LessWrong
In the course of researching optimization, Alex decided that he had to really understand what entropy is. But he found the existing resources (wikipe…
x Introduction to abstract entropy — LessWrong Entropy from first principles Information theory Entropy Logic & Mathematics Physics World Modeling Curated 252 Introduction to abstract entropy by Alex_Altair 20th Oct 2022 21 min read 78 252 This post, and much of the following sequence, was greatly aided by feedback from the following people (among others): Lawrence Chan , Joanna Morningstar , John Wentworth , Samira Nedungadi , Aysja Johnson , Cody Wild , Jeremy Gillen , Ryan Kidd , Justis Mills and Jonathan Mustin . Introduction & motivation In the course of researching optimization, I decide
Explore this link on the map →related reading
- What is Entropy? | Jason Fantljasonfantl.com
- Visual Information Theory -- colah's blogcolah.github.io
- What is Entropy? | Azimuthjohncarlosbaez.wordpress.com
- A Mathematical Theory of Communicationpeople.math.harvard.edu
- Shtetl-Optimized >> Blog Archive >> The First Law of Complexodynamicsscottaaronson.blog
- Entropy in thermodynamics and information theory - Wikipediaen.wikipedia.org
- statistical mechanics - Is information entropy the same as thermodynamic entropy? - Physics Stack Exchangephysics.stackexchange.com
- Cross-entropy | Anıl Zenginoğluanilzen.github.io
- Information entropy (Foundations of information theory: Part 2) - Matthew N. Bernsteinmbernste.github.io
- Maximum Entropy Methods (MaxEnt)bactra.org
- Kullback–Leibler divergence - Wikipediaen.wikipedia.org
- Visual Information Theory -- colah's blogcolah.github.io