Illuminating the Three Dogmas of RL under Evolutionary Light (Mani Hamidi) - Sensorimotor AI Journal Club
Last week, David Abel argued that RL’s central concepts (agent, learning, reward) need more precise definitions. He identified three dogmas limiting the field’s scientific ambitions. But he left one question conspicuously underdeveloped: what is adaptation, exactly?
Last week, David Abel argued that RL’s central concepts (agent, learning, reward) need more precise definitions. He identified three dogmas limiting the field’s scientific ambitions. But he left one question conspicuously underdeveloped: what is adaptation, exactly? This week, Mani Hamidi from the University of Tübingen picked up where Dave left off. His response paper offers evolutionary theory as a concrete paradigm that can address two of the three dogmas: it gives adaptation (Dogma 2) algorithmic substance through open-ended novelty search, and it complicates the reward hypothesis (Dogma 3
Explore this link on the map →saved by
related reading
- Plasticity as the Mirror of Empowerment (David Abel) - Sensorimotor AI Journal Clubsensorimotorai.github.io
- Evolution as Backstop for Reinforcement Learning · Gwern.netgwern.net
- Reward is not the optimization target — LessWronglesswrong.com
- Models Don't "Get Reward" — LessWronglesswrong.com
- A Crash Course in the Neuroscience of Human Motivation — LessWronglesswrong.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Reward Is Not Enough — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Open-endedness: The last grand challenge you’ve never heard of – O’Reillyoreilly.com
- Reward is not the optimization target — AI Alignment Forumalignmentforum.org
- Inner Alignment: Explain like I'm 12 Edition — LessWronglesswrong.com
- An Alien God — LessWronglesswrong.com