Deep Learning is Applied Topology - by theahura
Topology is a big scary math word that basically means 'the study of surfaces'. Imagine you had a surface made of play-doh. You could bend it, or twist it, or stretch it. But as long as you don't rip the play-doh up, or poke a hole through it, you can define certain properties that would remain true regardless of the deformation you apply. Here's an example. Let's say I flatten out my play-doh and then draw a circle on it. I could rotate it, or bend it, or twist it, or whatever. And my circle will change shape, for sure. But my circle will never magically become a line, nor will it suddenly become two circles, nor will it ever cross over itself. This is topology in a nutshell. Topology shows up in all sorts of places. For example, data science. Let's say you had a bunch of data that you wanted to classify. A lot of classification problems are equivalent to being able to cleanly separate data with a line. But when you go to plot the data on a 2D plane, it's just…kinda messy. There's no
When I think about AI, I think about topology. Topology is a big scary math word that basically means 'the study of surfaces'. Imagine you had a surface made of play-doh. You could bend it, or twist it, or stretch it. But as long as you don't rip the play-doh up, or poke a hole through it, you can define certain properties that would remain true regardless of the deformation you apply. Here's an example. Let's say I flatten out my play-doh and then draw a circle on it. I could rotate it, or bend it, or twist it, or whatever. And my circle will change shape, for sure. But my circle will…
related reading
- Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- An Applied Mathematician Strengthens AI With Pure Math | Quanta Magazinequantamagazine.org
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- Home - colah's blogcolah.github.io
- Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
- The World Inside Neural Networksgoodfire.ai
- Single Token Geometry 02: Manifold Tearingsubstack.com
- The Little Book of Deep Learningfleuret.org
- Theoretical Motivations for Deep Learning | Rinu Boneyrinuboney.github.io
- Understanding Deep Learningudlbook.github.io
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org