Renormalization Redux: QFT Techniques for AI Interpretability — LessWrong
In a previous post, Lauren offered a take on why a physics way of thinking is so successful at understanding AI systems. In this post, we look in more detail at the potential of Quantum field theory (QFT) to be expanded into a more comprehensive framework for this purpose. Interest in this area has been steadily increasing[1], but efforts have yet to condense into a larger-scale, coordinated effort. In particular, a lot of the more theoretical, technically detailed work remains opaque to anyone not well-versed in physics, meaning that insights[2] are largely disconnected from the AI safety community. The most accessible of these is Principles of Deep Learning theory (which we abbreviate “PDLT”), a nearly 500 page book that lays the groundwork for these ideas[3]. While there has been some AI safety research that has incorporated QFT-inspired threads[4], we see untapped potential for cross-disciplinary collaborations to unify these disparate directions. With this post – one of several in
x Renormalization Redux: QFT Techniques for AI Interpretability — LessWrong Renormalizing interpretability AI Frontpage 47 Renormalization Redux: QFT Techniques for AI Interpretability by Lauren Greenspan , Dmitry Vaintrob 18th Jan 2025 AI Alignment Forum 9 min read 12 47 Ω 19 Introduction: Why QFT? In a previous post , Lauren offered a take on why a physics way of thinking is so successful at understanding AI systems. In this post, we look in more detail at the potential of Quantum field theory (QFT) to be expanded into a more comprehensive framework for this purpose. Interest in this area ha
related reading
- Renormalization Redux: QFT Techniques for AI Interpretability — AI Alignment Forumalignmentforum.org
- Renormalization Roadmap — LessWronglesswrong.com
- Statistical Physics for Ambitious Interpretability: A Workshop Retrospective — LessWronglesswrong.com
- Study Guide — LessWronglesswrong.com
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- On Developing a Mathematical Theory of Interpretability — LessWronglesswrong.com
- A tale of three theories: sparsity, frustration, and statistical field theory — LessWronglesswrong.com
- [2307.08423] Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemsarxiv.org
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- The generalization phase diagram — LessWronglesswrong.com
- Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemsarxiv.org
- QFT and neural nets: the basic idea — LessWronglesswrong.com