Training language models to follow instructions with human feedback.pdf

N/A

Training language models to follow instructions with human feedback Long Ouyang∗ Jeff Wu∗ Xu Jiang∗ Diogo Almeida∗ Carroll L. Wainwright∗ Pamela Mishkin∗ Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray John Schulman Jacob Hilton Fraser Kelton Luke Miller Maddie Simens Amanda Askell† Peter Welinder Paul Christiano∗† Jan Leike∗ Ryan Lowe∗…

saved by

• Alex Becker

related reading

• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• Illustrating Reinforcement Learning from Human Feedback (RLHF)huggingface.co
• [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Modelarxiv.org
• [2204.14146] Training Language Models with Language Feedbackarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• 2401.10020.pdfarxiv.org
• [2302.08582] Pretraining Language Models with Human Preferencesarxiv.org
• user_interactions.pdfself-distillation.github.io
• Self-Adapting Language Modelsarxiv.org
• Constitutional AI: Harmlessness from AI Feedbackarxiv.org
• Language Models can Solve Computer Tasksarxiv.org
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org