OpenAI SAE Training Paper
arxiv.org · 6,903 words · saved by 1 readers
N/A
Scaling and evaluating sparse autoencoders Leo Gao∗ Tom Dupré la Tour† Henk Tillman† Gabriel Goh Rajan Troll Alec Radford Ilya Sutskever Jan Leike Jeffrey Wu† arXiv:2406.04093v1 [cs.LG] 6 Jun 2024 OpenAI…
related reading
- sparse-autoencoders.pdfcdn.openai.com
- [2406.04093] Scaling and evaluating sparse autoencodersarxiv.org
- An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability | Adam Karvonenadamkarvonen.github.io
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
- A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelsarxiv.org
- A gentle introduction to sparse autoencoders — LessWronglesswrong.com
- Matryoshka Sparse Autoencoders — LessWronglesswrong.com
- pdfopenreview.net
- Improving Dictionary Learning with Gated Sparse Autoencodersarxiv.org
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretabilityarxiv.org