Interpretability with Sparse Autoencoders (Colab exercises) — LessWrong
Update (13th October 2024) - these exercises have been significantly expanded on. Now there are 2 exercise sets: the first one dives deeply into theo…
x Interpretability with Sparse Autoencoders (Colab exercises) — LessWrong Sparse Autoencoders (SAEs) Exercises / Problem-Sets Interpretability (ML & AI) Superposition AI Frontpage 83 Interpretability with Sparse Autoencoders (Colab exercises) by CallumMcDougall 29th Nov 2023 AI Alignment Forum 4 min read 9 83 Ω 32 Update (13th October 2024) - these exercises have been significantly expanded on. Now there are 2 exercise sets: the first one dives deeply into theoretical topics related to superposition, while the second one (much larger) includes a streamlined version of the first one, as well as
related reading
- An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
- A gentle introduction to sparse autoencoders — LessWronglesswrong.com
- An Intuitive Explanation of Sparse Autoencoders for Mechanistic Interpretability of LLMs — LessWronglesswrong.com
- Matryoshka Sparse Autoencoders — LessWronglesswrong.com
- A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelsarxiv.org
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org
- GitHub - PaulPauls/llama3_interpretability_sae: A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.github.com
- A gentle introduction to sparse autoencodersnickjiang.substack.com
- Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
- Chapter 1: Transformer Interpretability - ARENAlearn.arena.education
- An Introduction to Exemplar Partitioning for Mechanistic Interpretability — LessWronglesswrong.com
- Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning — LessWronglesswrong.com