[1906.09624] On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inference

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[1906.09624] On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inference Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:1906.09624 (cs) [Submitted on 23 Jun 2019] Title: On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inference Authors: Rohin Shah , Noah Gundotra , Pieter Abbeel , Anca D. Dragan View a PDF of the paper titled On the Feasibility of Learning, Rather than Assuming, Human Biases for Rewar

related reading

• Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewarxiv.org
• [2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingarxiv.org
• [2506.10947] Spurious Rewards: Rethinking Training Signals in RLVRarxiv.org
• [2406.04219] Multi-Agent Imitation Learning: Value is Easy, Regret is Hardarxiv.org
• [2309.00267] RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackarxiv.org
• [1709.06560] Deep Reinforcement Learning that Mattersarxiv.org
• Deep Reinforcement Learning from Human Preferencesproceedings.neurips.cc
• [2607.18966] Measuring Reward-Seeking via Contrastive Belief Updatesarxiv.org
• [2605.12474] Reward Hacking in Rubric-Based Reinforcement Learningarxiv.org
• [2309.01809] Are Emergent Abilities in Large Language Models just In-Context Learning?arxiv.org
• [2512.18552] Toward Training Superintelligent Software Agents through Self-Play SWE-RLarxiv.org
• [2301.08028] A Tutorial on Meta-Reinforcement Learningarxiv.org