Fact Finding: Simplifying the Circuit (Post 2) — LessWrong
This is the second post in the Google DeepMind mechanistic interpretability team’s investigation into how language models recall facts. This post foc…
x Fact Finding: Simplifying the Circuit (Post 2) — LessWrong Interpretability (ML & AI) Frontpage 27 Fact Finding: Simplifying the Circuit (Post 2) by Senthooran Rajamanoharan , Neel Nanda , János Kramár , Rohin Shah 23rd Dec 2023 AI Alignment Forum 17 min read 3 27 Ω 16 This is the second post in the Google DeepMind mechanistic interpretability team’s investigation into how language models recall facts . This post focuses on distilling down the fact recall circuit and models a more standard mechanistic interpretability investigation. This post gets in the weeds, we recommend starting with pos
related reading
- Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level (Post 1) — AI Alignment Forumalignmentforum.org
- Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level (Post 1) — LessWronglesswrong.com
- Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- Verbalizable Representations Form a Global Workspace in Language Modelstransformer-circuits.pub
- Language Model Circuits Are Sparse in the Neuron Basis | Transluce AItransluce.org
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- interpreting GPT: the logit lens — LessWronglesswrong.com
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
- Towards Automated Circuit Discovery for Mechanistic Interpretabilityarxiv.org
- Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org