Building AGI Using Language Models | Leo Gao
Despite the buzz around GPT-3, it is, in and of itself, not AGI. In many ways, this makes it similar to AlphaGo or Deep Blue; while approaching human ability in one domain (playing Chess/Go, or writi
Created: 2020-08-17   Modified: 2020-08-17 Despite the buzz around GPT-3, it is, in and of itself, not AGI. In many ways, this makes it similar to AlphaGo or Deep Blue; while approaching human ability in one domain (playing Chess/Go, or writing really impressively), it doesn’t really seem like it will do Scary AGI Things™ any more than AlphaGo is going to be turning the Earth into paperclips anytime soon. While its writings are impressive at emulating humans, GPT-3 (or any potential future GPT-x) has no memory of past interactions, nor is it able to follow goals or maximize utility. Howev
related reading
- Simulators — LessWronglesswrong.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Large Language Model: world models or surface statistics?thegradient.pub
- Thoughts on the Alignment Implications of Scaling Language Models | Leo Gaobmk.sh
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Why didn't DeepMind build GPT3?rootnodes.substack.com
- Artificial General Intelligence Is Already Herenoemamag.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- The Near Future of AI is Action-Drivenjmcdonnell.substack.com
- Language Models can Solve Computer Tasksarxiv.org
- Noam Chomsky and GPT-3 - by Gary Marcus - Marcus on AIgarymarcus.substack.com