What is Entropy? | Jason Fantl
People say many things about entropy: entropy increases with time, entropy is disorder, entropy increases with energy, entropy determines the arrow of time, etc.. But I have no idea what entropy is, and from what I find, neither do most other people. This is the introduction I wish I had when first told about entropy, so hopefully you find it helpful. My goal is that by the end of this long post we will have a rigorous and intuitive understanding of those statements, and in particular, why the universe looks different when moving forward through time versus when traveling backward through time. This journey begins with defining and understanding entropy. There are multiple formal definitions of entropy across disciplines—thermodynamics, statistical mechanics, information theory—but they all share a central idea: entropy quantifies uncertainty. The easiest introduction to entropy is through Information Theory, which will lead to entropy in physical systems, and then finally to the relat
What is Entropy? | Jason Fantl Jason Fantl A computer science blog HOME CATEGORIES ARCHIVES ABOUT SUBSCRIBE Home What is Entropy? Post Cancel What is Entropy? Posted Mar 21, 2025 Updated Feb 22, 2026 By Jason Fantl 40 min read People say many things about entropy: entropy increases with time, entropy is disorder, entropy increases with energy, entropy determines the arrow of time, etc.. But I have no idea what entropy is, and from what I find, neither do most other people. This is the introduction I wish I had when first told about entropy, so hopefully you find it helpful. My goal is that by
Explore this link on the map →related reading
- Introduction to abstract entropy — LessWronglesswrong.com
- Entropy as an arrow of time - Wikipediaen.wikipedia.org
- What is Entropy? | Azimuthjohncarlosbaez.wordpress.com
- Entropy: The Hidden Force Making Life Complicatedfs.blog
- Entropy in thermodynamics and information theory - Wikipediaen.wikipedia.org
- statistical mechanics - Is information entropy the same as thermodynamic entropy? - Physics Stack Exchangephysics.stackexchange.com
- Cross-entropy | Anıl Zenginoğluanilzen.github.io
- Tại sao entropy trở thành vấn đề trong cuộc sống của chúng ta?spiderum.com
- Visual Information Theory -- colah's blogcolah.github.io
- Entropy: Why Life Always Seems to Get More Complicatedjamesclear.com
- Shtetl-Optimized >> Blog Archive >> The First Law of Complexodynamicsscottaaronson.blog
- 12.3 Second Law of Thermodynamics: Entropy - Physics | OpenStaxopenstax.org