Illuminating the Three Dogmas of RL under Evolutionary Light (Mani Hamidi) - Sensorimotor AI Journal Club
Last week, David Abel argued that RL’s central concepts (agent, learning, reward) need more precise definitions. He identified three dogmas limiting the field’s scientific ambitions. But he left one question conspicuously underdeveloped: what is adaptation, exactly?
Last week, David Abel argued that RL’s central concepts (agent, learning, reward) need more precise definitions. He identified three dogmas limiting the field’s scientific ambitions. But he left one question conspicuously underdeveloped: what is adaptation, exactly? This week, Mani Hamidi from the University of Tübingen picked up where Dave left off. His response paper offers evolutionary theory as a concrete paradigm that can address two of the three dogmas: it gives adaptation (Dogma 2) algorithmic substance through open-ended novelty search, and it complicates the reward hypothesis (Dogma 3
saved by
related reading
- Plasticity as the Mirror of Empowerment (David Abel) - Sensorimotor AI Journal Clubsensorimotorai.github.io
- Evolution as Backstop for Reinforcement Learning · Gwern.netgwern.net
- Reward is not the optimization target — LessWronglesswrong.com
- Models Don't "Get Reward" — LessWronglesswrong.com
- State of RL for reasoning LLMs | A. Weersaweers.de
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Reward Is Not Enough — LessWronglesswrong.com
- A Visual Guide to Evolution Strategies | 大トロblog.otoro.net
- Three Questions that Keep Me Up at Night | Eric Jangevjang.com
- Reward Is Not the Optimization Targetturntrout.com
- [2412.14135] Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspectivearxiv.org
- [AN #70]: Agents that help humans who are still learning about their own preferences — LessWronglesswrong.com