SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
arxiv.org · 6,315 words · saved by 1 readers
N/A
SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability Adam Karvonen * 1 Can Rager * 1 Johnny Lin * 2 Curt Tigges * 2 Joseph Bloom * 2 David Chanin 3 Yeu-Tong Lau 1 Eoin Farrell 1 Callum McDougall Kola Ayonrinde Demian Till 4 Matthew Wearden 5 Arthur Conmy Samuel Marks 6 Neel Nanda…
related reading
- An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
- A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelsarxiv.org
- Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- A gentle introduction to sparse autoencoders — LessWronglesswrong.com
- Matryoshka Sparse Autoencoders — LessWronglesswrong.com
- An Introduction to Exemplar Partitioning for Mechanistic Interpretability — LessWronglesswrong.com
- Sparse Autoencoders Reveal Universal Feature Spaces Across Large Language Modelsarxiv.org
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
- Improving Dictionary Learning with Gated Sparse Autoencodersarxiv.org
- Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning — LessWronglesswrong.com
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub