[1805.00909] Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack
View PDF HTML (experimental) Abstract:The framework of reinforcement learning or optimal control provides a mathematical formalization of intelligent decision making that is powerful and broadly applicable. While the general form of the reinforcement learning problem enables effective reasoning about uncertainty, the connection between reinforcement learning and inference in probabilistic models is not immediately obvious. However, such a connection has considerable value when it comes to algorithm design: formalizing a problem as probabilistic inference in principle allows us to bring to…
saved by
related reading
- Reinforcement Learning in Newcomblike Problemsproceedings.neurips.cc
- Reinforcement Learning: Machine Learning Meets Control Theoryyoutube.com
- [1709.06560] Deep Reinforcement Learning that Mattersarxiv.org
- A Gallery of Methods Beyond RL — Part I: Sampling Methodsshengyu-feng.github.io
- [2602.11399] Can We Really Learn One Representation to Optimize All Rewards?arxiv.org
- ML Mentorship: Some Q/A about RLevjang.com
- [2301.08028] A Tutorial on Meta-Reinforcement Learningarxiv.org
- [2005.01643] Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemsar5iv.labs.arxiv.org
- [2006.05990] What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Studyarxiv.org
- [2510.13651] What is the objective of reasoning with reinforcement learning?arxiv.org
- [2503.09829] SE(3)-Equivariant Robot Learning and Control: A Tutorial Surveyarxiv.org
- A Free Lunch from the Noise:Provable and Practical Exploration for Representation Learningarxiv.org