2305.14314

N/A

QL O RA: Efficient Finetuning of Quantized LLMs Tim Dettmers∗ Artidoro Pagnoni∗ Ari Holtzman Luke Zettlemoyer arXiv:2305.14314v1 [cs.LG] 23 May 2023 University of Washington {dettmers,artidoro,ahai,lsz}@cs.washington.edu…

saved by

• Saloni Shenoy
• Sebastian J Zhao

related reading

• [2510.11696] QeRL: Beyond Efficiency -- Quantization-enhanced Reinforcement Learning for LLMsarxiv.org
• 2005.14165arxiv.org
• [2506.06105] Text-to-LoRA: Instant Transformer Adaptionarxiv.org
• LoRA Without Regret - Thinking Machines Labthinkingmachines.ai
• [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• 2210.17323arxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic Studyarxiv.org
• In-depth guide to fine-tuning LLMs with LoRA and QLoRA | Mercity Researchmercity.ai
• Efficient LLM Finetuning with Unsloth | Modal Docsmodal.com
• 2106.09685arxiv.org