dim sum paper

N/A

Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Models Jaehun Jung† Peter West† Liwei Jiang† Faeze Brahman†‡ Ximing Lu† Jillian Fisher† Taylor Sorensen† Yejin Choi†‡ † Paul G. Allen School of Computer Science & Engineering, University of Washington…

saved by

• Chloe Wong

related reading

• spreadsheetLLMarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• 2409.02908arxiv.org
• Large Language Diffusion Modelsarxiv.org
• Self-Adapting Language Modelsarxiv.org
• 2308.03958arxiv.org
• 2502.11089arxiv.org
• A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Modelsarxiv.org
• [2605.23857] Strong Teacher Not Needed? On Distillation in LLM Pretrainingarxiv.org
• 2025.findings-emnlp.313.pdfaclanthology.org
• 2026.mellm-1.2.pdfaclanthology.org
• Sparse Autoencoders Find Highly Interpretable Features in Language Modelsarxiv.org