2408.14690
arxiv.org · 7,921 words · saved by 1 readers
N/A
Published as a conference paper at ICLR 2025 T RAINING -F REE ACTIVATION S PARSITY IN L ARGE L ANGUAGE M ODELS James Liu1,2∗ Pragaash Ponnusamy2 Tianle Cai3 Han Guo1 Yoon Kim1 Ben Athiwaratkun2 1 2 3 Massachusetts Institute of Technology Together AI Princeton University…
saved by
related reading
- A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelsarxiv.org
- 2409.02908arxiv.org
- 2502.11089arxiv.org
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
- Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org
- 2403.09611.pdfarxiv.org
- [2402.12374] Sequoia: Scalable, Robust, and Hardware-aware Speculative Decodingarxiv.org
- 2305.14314arxiv.org
- [2607.14111] Introspection Fine-Tuning (IFT): Training Small LLMs to Introspectarxiv.org
- pdfopenreview.net
- 2401.02415.pdfarxiv.org