Reinforcement Learning via Implicit Imitation Guidance

This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions. HTML conversions sometimes display errors due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on. Authors: achieve the best HTML results from your LaTeX submissions by following these best practices. We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective, either as regularization during training or to acquire a reference policy. However, imitation learning objectives can ultimately degrade

Reinforcement Learning via Implicit Imitation Guidance Perry Dong*, Alec M. Lessing*, Annie S. Chen*, Chelsea Finn Stanford University; {perryd, aleclessing, asc8}@stanford.edu Abstract We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective, either as regularization during training or to acquire a reference policy. However, imitation learning objectives can ultimately degrade long-term performance, as it does no

saved by

• Alexiy Buynitsky

related reading

• Ch. 21 - Imitation Learningunderactuated.mit.edu
• [1709.06560] Deep Reinforcement Learning that Mattersarxiv.org
• 1011.0686arxiv.org
• Should I Use Offline RL or Imitation Learning? – The Berkeley Artificial Intelligence Research Blogbair.berkeley.edu
• [2103.06326] S4RL: Surprisingly Simple Self-Supervision for Offline Reinforcement Learningarxiv.org
• [2606.09758] Difference-Aware Retrieval Policies for Imitation Learningarxiv.org
• Exploration for the Efficient Deployment of Reinforcement Learning Agentsopenreview.net
• Imitating Latent Policies from Observationarxiv.org
• Imitation Bootstrapped Reinforcement Learningarxiv.org
• Decoupling Representation Learning from Reinforcement Learningarxiv.org
• Contrastive Learning as Goal-Conditioned Reinforcement Learningarxiv.org
• Deep Reinforcement Learning from Human Preferencesproceedings.neurips.cc