Why I'm bearish on mechanistic interpretability: the shards are not in the network — LessWrong
lesswrong.com · 5,754 words · saved by 1 readers
Once upon a time, the sun let out a powerful beam of light which shattered the world. The air and the liquid was split, turning into body and breath.…
x Why I'm bearish on mechanistic interpretability: the shards are not in the network — LessWrong Interpretability (ML & AI) Shard Theory AI Frontpage 24 Why I'm bearish on mechanistic interpretability: the shards are not in the network by tailcalled 13th Sep 2024 1 min read 40 24 Once upon a time, the sun let out a powerful beam of light which shattered the world. The air and the liquid was split, turning into body and breath. Body and breath became fire, trees and animals. In the presence of the lightray, any attempt to reunite simply created more shards, of mushrooms, carnivores, herbivores
related reading
- A Comprehensive Mechanistic Interpretability Explainer & Glossary — Neel Nandaneelnanda.io
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
- Transformer Circuits Threadtransformer-circuits.pub
- Dario Amodei — The Urgency of Interpretabilitydarioamodei.com
- A short note on interpretability and mindsericjmichaud.com
- An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- An Ambitious Vision for Interpretability — AI Alignment Forumalignmentforum.org
- Lucius Bushnaq's Shortform — LessWronglesswrong.com
- Interpretability Dreamstransformer-circuits.pub