Why I'm bearish on mechanistic interpretability: the shards are not in the network — LessWrong

Once upon a time, the sun let out a powerful beam of light which shattered the world. The air and the liquid was split, turning into body and breath.…

x Why I'm bearish on mechanistic interpretability: the shards are not in the network — LessWrong Interpretability (ML & AI) Shard Theory AI Frontpage 24 Why I'm bearish on mechanistic interpretability: the shards are not in the network by tailcalled 13th Sep 2024 1 min read 40 24 Once upon a time, the sun let out a powerful beam of light which shattered the world. The air and the liquid was split, turning into body and breath. Body and breath became fire, trees and animals. In the presence of the lightray, any attempt to reunite simply created more shards, of mushrooms, carnivores, herbivores

related reading

• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Transformer Circuits Threadtransformer-circuits.pub
• An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
• Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
• An Ambitious Vision for Interpretability — AI Alignment Forumalignmentforum.org
• Lucius Bushnaq's Shortform — LessWronglesswrong.com
• An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
• Introduction to Mechanistic Interpretability - by Sarahblog.bluedot.org
• Sparsify: A mechanistic interpretability research agenda — AI Alignment Forumalignmentforum.org
• Interpretability Dreamstransformer-circuits.pub
• Neel Nanda on Mechanistic Interpretability: Progress, Limits, and Paths to Safer AI — EA Forumforum.effectivealtruism.org