2106.09685
arxiv.org · 7,955 words · saved by 1 readers
N/A
L O RA: L OW-R ANK A DAPTATION OF L ARGE L AN - GUAGE M ODELS Edward Hu∗ Yelong Shen∗ Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen Microsoft Corporation {edwardhu, yeshe, phwallis, zeyuana, yuanzhil, swang, luw, wzchen}@microsoft.com…
related reading
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- LoRA Without Regret - Thinking Machines Labthinkingmachines.ai
- [2506.06105] Text-to-LoRA: Instant Transformer Adaptionarxiv.org
- LoRA vs Full Fine-tuning: An Illusion of Equivalencearxiv.org
- Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA) - Lightning AIlightning.ai
- 2305.14314arxiv.org
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Self-Adapting Language Modelsarxiv.org
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
- Learning to Reason in 13 Parametersarxiv.org
- 2401.02415.pdfarxiv.org