Hierarchically organized behavior and its neural foundations: A reinforcement-learning perspective

Research on human and animal behavior has long emphasized its hierarchical structure — the divisibility of ongoing behavior into discrete tasks, which are comprised of subtask sequences, which in turn are built of simple actions. The hierarchical ...

Cognition . Author manuscript; available in PMC: 2010 Dec 1. Published in final edited form as: Cognition. 2008 Oct 15;113(3):262–280. doi: 10.1016/j.cognition.2008.08.011 Hierarchically organized behavior and its neural foundations: A reinforcement-learning perspective Matthew M Botvinick Matthew M Botvinick 1 Princeton Neuroscience Institute and Department of Psychology, Princeton University Find articles by Matthew M Botvinick 1 , Yael Niv Yael Niv 2 Princeton Neuroscience Institute and Department of Psychology, Princeton University Find articles by Yael Niv 2 , Andrew C Barto Andrew C Bart

related reading

• The Promise of Hierarchical Reinforcement Learningthegradient.pub
• Hierarchical Reinforcement Learning | Towards Data Sciencetowardsdatascience.com
• A Crash Course in the Neuroscience of Human Motivation — LessWronglesswrong.com
• Part 1: Key Concepts in RL - Spinning Up documentationspinningup.openai.com
• pdfopenreview.net
• Reward is not the optimization target — LessWronglesswrong.com
• Reward Hacking in Reinforcement Learning | Lil'Loglilianweng.github.io
• A (Long) Peek into Reinforcement Learning | Lil'Loglilianweng.github.io
• Models Don't "Get Reward" — LessWronglesswrong.com
• Q-learning is not yet scalableseohong.me
• [2010.15638] Abstract Value Iteration for Hierarchical Reinforcement Learningarxiv.org
• Deep Reinforcement Learning from Human Preferencesproceedings.neurips.cc