Renormalization Roadmap — LessWrong
At PIBBSS, we’ve been thinking about how renormalization can be developed into a rich framework for AI interpretability. This document serves as a roadmap for this research agenda – which we are calling an Opportunity Space[1] for the AI safety community. In what follows, we explore the technical and philosophical significance of renormalization for physics and AI safety, problem areas in which it could be most useful, and some interesting existing directions – mainly from physics – that we are excited to place in direct contact with AI safety. This roadmap will also provide context for our forthcoming Call for Collaborations, during which we will hire affiliates to work on projects in this area. Acknowledgements: While Lauren did the writing, this opportunity space was developed with the PIBBSS horizon scanning team, Dmitry Vaintrob and Lucas Teixeira. In physics, renormalization is used to coarse-grain theoretical descriptions of complex interactions to focus on those that are most r
x Renormalization Roadmap — LessWrong Renormalizing interpretability AI Frontpage 64 Renormalization Roadmap by Lauren Greenspan 31st Mar 2025 AI Alignment Forum 22 min read 7 64 Ω 32 At PIBBSS, we’ve been thinking about how renormalization can be developed into a rich framework for AI interpretability. This document serves as a roadmap for this research agenda – which we are calling an Opportunity Space [1] for the AI safety community. In what follows, we explore the technical and philosophical significance of renormalization for physics and AI safety, problem areas in which it could be most
Explore this link on the map →related reading
- Renormalization Redux: QFT Techniques for AI Interpretability — LessWronglesswrong.com
- Renormalization Redux: QFT Techniques for AI Interpretability — AI Alignment Forumalignmentforum.org
- Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
- Problem Areas in Physics and AI Safety | Apart Researchapartresearch.com
- Statistical Physics for Ambitious Interpretability: A Workshop Retrospective — LessWronglesswrong.com
- An Ambitious Vision for Interpretability — AI Alignment Forumalignmentforum.org
- A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
- The Building Blocks of Interpretabilitydistill.pub
- On Optimism for Interpretabilitygoodfire.ai
- On Developing a Mathematical Theory of Interpretability — LessWronglesswrong.com
- Interpretability Dreamstransformer-circuits.pub
- 2023 letter | Zhengdongzhengdongwang.com