The (Metro)logic of Machine Learning - by Maxim Raginsky
In his book Simplexity: Simplifying Principles for a Complex World, neuroscientist Alain Berthoz opens one of the chapters with the following quote from psychophysicist Jan Koenderink: The world is infinitely complicated, yet the only way to investigate it is to ask questions. . . . The questions imply the answers and act as a “format” for converting simple structures into meaningful information. In this way, intention and meaning are imposed by the observer. To be a good observer requires being able to ask relevant questions of nature or, to put it differently, to have an interface that makes the world appear sufficiently simple to ensure survival. We need simple and effective geometries for interfaces, in contrast to the theories inevitably offered by physics. This is a statement about the importance of measurement and, more immediately, about the importance of making the right measurements at the right level of complexity. Through the long and slow process of evolution, and then at
In his book Simplexity: Simplifying Principles for a Complex World, neuroscientist Alain Berthoz opens one of the chapters with the following quote from psychophysicist Jan Koenderink: The world is infinitely complicated, yet the only way to investigate it is to ask questions. . . . The questions imply the answers and act as a “format” for converting simple structures into meaningful information. In this way, intention and meaning are imposed by the observer. To be a good observer requires being able to ask relevant questions of nature or, to put it differently, to have an interface that…
saved by
related reading
- [1911.01547] On the Measure of Intelligencearxiv.org
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- The World Inside Neural Networksgoodfire.ai
- A Functional Taxonomy of World Models - Dr. Fei-Fei Lidrfeifei.substack.com
- Why poetry is a variety of mathematical experienceaeon.co
- Machine Learning, Kolmogorov Complexity, and Squishy Bunniestheorangeduck.com
- The necessity of machine learning theory in mitigating AI riskmishabelkin.substack.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- How To Think Real Good | Meta-rationalitymetarationality.com
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- What if not Circuits? — LessWronglesswrong.com
- Five Philosophy Papers Everyone* Should Readsubstack.com