Noam Chomsky and GPT-3 - by Gary Marcus

Are large language models a good model of *human* language?

Noam Chomsky and GPT-3 Are large language models a good model of *human* language? Gary Marcus May 21, 2022 98 28 4 Share “ You can’t go to a physics conference and say: I’ve got a great theory. It accounts for everything and is so simple it can be captured in two words: “Anything goes.”" - Noam Chomsky, 15 May 2022 Every now and then engineers make an advance, and scientists and lay people begin to ponder the question of whether that advance might yield important insight into the human mind. Descartes wondered whether the mind might work on hydraulic principles; throughout the second half of

related reading

• The Scaling Hypothesis · Gwern.netgwern.net
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• Non-Human Words: On GPT-3 as a Philosophical Laboratory | American Academy of Arts and Sciencesamacad.org
• Giving GPT-3 a Turing Testlacker.io
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
• The Human Skill That Eludes AI - The Atlantictheatlantic.com
• Large Language Model: world models or surface statistics?thegradient.pub
• Mediumpub.towardsai.net
• Why didn't DeepMind build GPT3?rootnodes.substack.com
• Building AGI Using Language Models | Leo Gaobmk.sh