What Is The True Name of Modularity? — LessWrong
TL;DR Modularity seems like an important feature of neural networks, but there is currently no canonical way of properly defining or measuring it whi…
x What Is The True Name of Modularity? — LessWrong Selection Theorems: Modularity Modularity Causality Information theory World Modeling AI Frontpage 41 What Is The True Name of Modularity? by CallumMcDougall , Lucius Bushnaq , Avery 1st Jul 2022 AI Alignment Forum 14 min read 10 41 Ω 16 TL;DR Modularity seems like an important feature of neural networks, but there is currently no canonical way of properly defining or measuring it which is properly theoretically motivated and doesn’t break down in some cases - in other words, we haven’t yet found a True Name for it. Most modularity measures us
related reading
- Modular Manifolds - Thinking Machines Labthinkingmachines.ai
- Six (and a half) intuitions for KL divergence — LessWronglesswrong.com
- Investigating the learning coefficient of modular addition: hackathon project — LessWronglesswrong.com
- What Would Non-Linear Features Actually Look Like? — Liv Gortonlivgorton.com
- Neural networks are not already cleanlesswrong.com
- What if not Circuits? — LessWronglesswrong.com
- The Building Blocks of Interpretabilitydistill.pub
- The World Inside Neural Networksgoodfire.ai
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- Naturally Occurring Equivariance in Neural Networksdistill.pub
- Modularity of Mindplato.stanford.edu
- Causal scrubbing: Appendix — LessWronglesswrong.com