2210.17323

arxiv.org · 7,420 words · saved by 1 readers

N/A

Published as a conference paper at ICLR 2023 GPTQ: ACCURATE P OST-T RAINING Q UANTIZATION FOR G ENERATIVE P RE - TRAINED T RANSFORMERS Elias Frantar∗ Saleh Ashkboos Torsten Hoefler Dan Alistarh IST Austria ETH Zurich ETH Zurich IST Austria & NeuralMagic A BSTRACT…

related reading

GPTQ: Accurate Post-Training Quantization for Generative Pre-Trained Transformersarxiv.org
2305.14314arxiv.org
[2309.10668] Language Modeling Is Compressionarxiv.org
Compression and Intelligencegreene.sh
[2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
[2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
[2510.11696] QeRL: Beyond Efficiency -- Quantization-enhanced Reinforcement Learning for LLMsarxiv.org
Quantization from the ground upngrok.com
2112.10769arxiv.org
Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
Efficient LLM inferencefinbarrtimbers.substack.com
[2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org