[2308.07633] A Survey on Model Compression for Large Language Models

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2308.07633] A Survey on Model Compression for Large Language Models Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Computation and Language arXiv:2308.07633 (cs) [Submitted on 15 Aug 2023 ( v1 ), last revised 30 Jul 2024 (this version, v4)] Title: A Survey on Model Compression for Large Language Models Authors: Xunyu Zhu , Jian Li , Yong Liu , Can Ma , Weiping Wang View a PDF of the paper titled A Survey on Model Compression for Large Language Models, by Xunyu Zhu and 4 other aut

related reading

• [2309.10668] Language Modeling Is Compressionarxiv.org
• Compression and Intelligencegreene.sh
• [2306.07629] SqueezeLLM: Dense-and-Sparse Quantizationarxiv.org
• [2503.07003] Large Language Models Often Say One Thing and Do Anotherarxiv.org
• Large Language Diffusion Modelsarxiv.org
• [2509.14786] Pre-training under infinite computearxiv.org
• [2406.11717] Refusal in Language Models Is Mediated by a Single Directionarxiv.org
• [2309.01809] Are Emergent Abilities in Large Language Models just In-Context Learning?arxiv.org
• [2312.15159] Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inferencearxiv.org
• [2512.19428] Attention Is Not What You Needarxiv.org
• [2301.00234] A Survey on In-context Learningarxiv.org
• [2304.07493] OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantizationarxiv.org