user_interactions.pdf
self-distillation.github.io · 8,336 words · saved by 1 readers
N/A
Aligning Language Models from User Interactions Aligning Language Models from User Interactions Thomas Kleine Buening1 Jonas Hübotter1 Barna Pásztor1 Idan Shenfeld2 Giorgia Ramponi3 Andreas Krause1 1 ETH Zurich 2 MIT 3 University of Zurich Abstract Multi-turn user interactions are among the most abundant data produced by language models, yet we lack effective methods to learn from them. While typically discarded, these interactions often contain useful information: follow-up user messages may…
saved by
related reading
- [2508.19227] Generative Interfaces for Language Modelsarxiv.org
- Quantifying the Utility of User Simulators for Building Collaborative LLM Assistantsarxiv.org
- LLMs Get Lost in Evolving User Intentarxiv.org
- [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Modelarxiv.org
- Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc
- Self-Adapting Language Modelsarxiv.org
- [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
- 2401.10020.pdfarxiv.org
- [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
- [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
- Training and Evaluating User Language Modelsarxiv.org
- 2308.03958arxiv.org