On neural scaling and the quanta hypothesis
Several years ago, humanity began an experiment. This experiment is now on track to become one of the most expensive ever attempted. We don't yet know what the results of this experiment will be. Certain results could be transformative. The experiment could not only alter the dynamics of wealth and power in human life, but change our basic status as a species: it could put us in contact with alien minds more capable than our own for the first time. Alternatively, some still predict that the experiment will be largely a waste of time and energy. Despite its importance, we don't have a mature theory backing this experiment. And the number of people working on such a theory in public is relatively small.
On neural scaling and the quanta hypothesis --> On neural scaling and the quanta hypothesis 2026-01-12 Testing testing testing. --> Several years ago, humanity began an experiment. This experiment is now on track to become one of the most expensive ever attempted. We don't yet know what the results of this experiment will be. Certain results could be transformative. The experiment could not only alter the dynamics of wealth and power in human life, but change our basic status as a species: it could put us in contact with alien minds more capable than our own for the first time. Alternatively,
saved by
- Tasha Pais
- Hangyul Lyna Kim
- Asher P
- Sudarsh K
- Paul Scotti
- Dhruv Sheth
- Vincent Huang
- Akira Yoshiyama
- Davis Brown
- Sheikh Abdur Raheem Ali
- Rohan Kathuria
- Jack Zheng
related reading
- A short note on interpretability and mindsericjmichaud.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Will scaling work?dwarkeshpatel.com
- Scaling is subtler than it seemsberen.io
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- The social AI hypothesissubstack.com
- Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
- Future ML Systems Will Be Qualitatively Differentbounded-regret.ghost.io
- [2608.13335] Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Lawsarxiv.org
- Q-learning is not yet scalableseohong.me
- What If We Had Bigger Brains? Imagining Minds beyond Ours-Stephen Wolfram Writingswritings.stephenwolfram.com
- Human-like Neural Nets by Catapulting · Gwern.netgwern.net