✳flâneur — a map of the web's best reading

Cross-entropy | Anıl Zenginoğlu

anilzen.github.io · 2,794 words · saved by 1 readers

Cross-entropy is a measure of the difference between two probability distributions. It also plays a role in the information-theoretic formulation of the Second Law of Thermodynamics, thereby providing a bridge between physics and machine learning.

Cross-entropy Crossing the bridge between physics and machine learning. Anıl Zenginoğlu Apr 2, 2023 13 min read We're all gonna die. Blame the Second Law of Thermodynamics. Entropy increases, we get older, and we die. Mark Thompson, New Yorker Magazine This perception of entropy, prevalent in popular culture, presents it as the driving force for decay and disorder. But this cannot be the whole story. The incredible abundance of life on our planet would not have been possible without the self-organization of complex systems. The story of entropy and life is more complicated than the boy in the

Explore this link on the map →

saved by

related reading