Theory of the World, Theory of Mind, and Media Incentives
This post will mostly just restate what I said here, so you can skip it if you read that post. But with absurd AI talk running wild - right now discussion of this topic is one of the least responsible moments I can remember in contemporary media history, which is
This post will mostly just restate what I said here, so you can skip it if you read that post. But with absurd AI talk running wild - right now discussion of this topic is one of the least responsible moments I can remember in contemporary media history, which is really saying something - I’m moved again to make a basic point about large language models like ChatGPT. Decades ago, a computer scientist named Terry Winograd pointed out that there’s no such thing as a system that can truly master language without a theory of the world. That is to say, as the science of meaning, semantics cannot…
related reading
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- What does meaning mean?cognitivewonderland.substack.com
- Large Language Model: world models or surface statistics?thegradient.pub
- Theory of Mind May Have Spontaneously Emerged in Large Language Modelsnews.ycombinator.com
- ChatGPT Is Nothing Like a Human, Says Linguist Emily Bendernymag.com
- Noam Chomsky and GPT-3 - by Gary Marcus - Marcus on AIgarymarcus.substack.com
- Meaningful | Slate Star Codexslatestarcodex.com
- LLMs and World Models, Part 1 - by Melanie Mitchellaiguide.substack.com
- Shtetl-Optimized >> Blog Archive >> The False Promise of Chomskyismscottaaronson.blog
- The Yale Review | Melanie Mitchell: The Dangerous Unknowns at the…yalereview.org