[2004.05107] Levels of Analysis for Machine Learning
Machine learning is currently involved in some of the most vigorous debates it has ever seen. Such debates often seem to go around in circles, reaching no conclusion or resolution. This is perhaps unsurprising given that researchers in machine learning come to these discussions with very different frames of reference, making it challenging for them to align perspectives and find common ground. As a remedy for this dilemma, we advocate for the adoption of a common conceptual framework which can be used to understand, analyze, and discuss research. We present one such framework which is popular in cognitive science and neuroscience and which we believe has great utility in machine learning as well: Marr’s levels of analysis. Through a series of case studies, we demonstrate how the levels facilitate an understanding and dissection of several methods from machine learning. By adopting the levels of analysis in one’s own work, we argue that researchers can be better equipped to engage in th
Levels of Analysis for Machine Learning Jessica B. Hamrick DeepMind jhamrick@google.com &Shakir Mohamed DeepMind shakir@google.com Abstract Machine learning is currently involved in some of the most vigorous debates it has ever seen. Such debates often seem to go around in circles, reaching no conclusion or resolution. This is perhaps unsurprising given that researchers in machine learning come to these discussions with very different frames of reference, making it challenging for them to align perspectives and find common ground. As a remedy for this dilemma, we advocate for the adoption of a
saved by
related reading
- As Rocks May Think | Eric Jangevjang.com
- NL.pdfabehrouz.github.io
- The Little Book of Deep Learningfleuret.org
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Interpretability Dreamstransformer-circuits.pub
- Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- Building machines that learn and think like people | Behavioral and Brain Sciences | Cambridge Corecambridge.org
- How to get from high school math to cutting-edge ML/AI: a detailed 4-stage roadmap with links to the best learning resources that I’m aware of.justinmath.com
- Non_Interactive – Software & MLnonint.com