Rediscovery of Interiority in ML
In the history of science there is an important distinction between the work of producing a new experimental or theoretical fact and the work of interpreting it as part of a broader tapestry of knowledge and progress. The work of interpretation is risky, but important. Much as Columbus' belief that the world was round gave him the courage to attempt to sail around it, a novel interpretation of a scientific result can give researchers the determination to begin ambitious new projects. To observers who lack the proper context, scientific projects can often seem bizarre or silly - think of Millikan laboring to suspend oil droplets in midair, or Einstein studying the random motion of pollen particles in water. The philosophical ideas of this essay will hopefully inspire researchers to begin new lines of world-changing work that would previously have been dismissed as meaningless or eccentric. Confucius said that his first act upon receiving public office would be to rectify the names. In t
Rediscovery of Interiority in ML The Rediscovery of Interiority in Machine Learning In the history of science there is an important distinction between the work of producing a new experimental or theoretical fact and the work of interpreting it as part of a broader tapestry of knowledge and progress. The work of interpretation is risky, but important. Much as Columbus' belief that the world was round gave him the courage to attempt to sail around it, a novel interpretation of a scientific result can give researchers the determination to begin ambitious new projects. To observers who lack the p
Explore this link on the map →related reading
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Interpretability Dreamstransformer-circuits.pub
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- On Optimism for Interpretabilitygoodfire.ai
- How To Become A Mechanistic Interpretability Researcher — LessWronglesswrong.com
- Large Language Model: world models or surface statistics?thegradient.pub
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Scaling in the service of reasoning & model-based ML | Yoshua Bengioyoshuabengio.org
- A Bird's Eye View of the ML Field [Pragmatic AI Safety #2] — AI Alignment Forumalignmentforum.org
- The necessity of machine learning theory in mitigating AI riskmishabelkin.substack.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai