Renormalization Roadmap — LessWrong

At PIBBSS, we’ve been thinking about how renormalization can be developed into a rich framework for AI interpretability. This document serves as a roadmap for this research agenda – which we are calling an Opportunity Space[1] for the AI safety community. In what follows, we explore the technical and philosophical significance of renormalization for physics and AI safety, problem areas in which it could be most useful, and some interesting existing directions – mainly from physics – that we are excited to place in direct contact with AI safety. This roadmap will also provide context for our forthcoming Call for Collaborations, during which we will hire affiliates to work on projects in this area. Acknowledgements: While Lauren did the writing, this opportunity space was developed with the PIBBSS horizon scanning team, Dmitry Vaintrob and Lucas Teixeira. In physics, renormalization is used to coarse-grain theoretical descriptions of complex interactions to focus on those that are most r

x Renormalization Roadmap — LessWrong Renormalizing interpretability AI Frontpage 64 Renormalization Roadmap by Lauren Greenspan 31st Mar 2025 AI Alignment Forum 22 min read 7 64 Ω 32 At PIBBSS, we’ve been thinking about how renormalization can be developed into a rich framework for AI interpretability. This document serves as a roadmap for this research agenda – which we are calling an Opportunity Space [1] for the AI safety community. In what follows, we explore the technical and philosophical significance of renormalization for physics and AI safety, problem areas in which it could be most

related reading

• Renormalization Redux: QFT Techniques for AI Interpretability — LessWronglesswrong.com
• Renormalization Redux: QFT Techniques for AI Interpretability — AI Alignment Forumalignmentforum.org
• Statistical Physics for Ambitious Interpretability: A Workshop Retrospective — LessWronglesswrong.com
• Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
• Problem Areas in Physics and AI Safety | Apart Researchapartresearch.com
• A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
• What is the purpose of interpretability?ericjmichaud.com
• The Building Blocks of Interpretabilitydistill.pub
• An Ambitious Vision for Interpretability — AI Alignment Forumalignmentforum.org
• Interpretability Dreamstransformer-circuits.pub
• Assessing skeptical views of interpretability research | Christopher Pottsweb.stanford.edu
• On Optimism for Interpretabilitygoodfire.ai