Theory of the World, Theory of Mind, and Media Incentives
This post will mostly just restate what I said here, so you can skip it if you read that post. But with absurd AI talk running wild - right now discussion of this topic is one of the least responsible moments I can remember in contemporary media history, which is
This post will mostly just restate what I said here, so you can skip it if you read that post. But with absurd AI talk running wild - right now discussion of this topic is one of the least responsible moments I can remember in contemporary media history, which is really saying something - I’m moved again to make a basic point about large language models like ChatGPT. Decades ago, a computer scientist named Terry Winograd pointed out that there’s no such thing as a system that can truly master language without a theory of the world. That is to say, as the science of meaning, semantics cannot…
related reading
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- Simulators — LessWronglesswrong.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- What does meaning mean?cognitivewonderland.substack.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- And Yet It Understandsborretti.me
- Natural Language Is an Unnatural Interfacevarunshenoy.substack.com
- Theory of Mind May Have Spontaneously Emerged in Large Language Modelsnews.ycombinator.com
- ChatGPT Is Dumber Than You Think - The Atlantictheatlantic.com
- Large Language Model: world models or surface statistics?thegradient.pub
- God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniquesastralcodexten.com
- How AI Is Learning to Think in Secretnickandresen.substack.com