Hayden Donnelly
The thing is, I'm kinda retarded. I mean I don't even know what Kolmogorov complexity is. Apparently it has something to do with algorithms and maybe information. These both seem like pretty important aspects of world models, so I should probably learn what Kolmogorov complexity is, but I'm not going to because it's 4:16 AM. Really I just want to write about the things already floating around in my head. Let's start with what I've heard about world models. To begin with, my simcluster has told me that language models are world models, and also image models, and also video models. Apparently these media are created by the world and we can learn something about the world by modelling them. One guy said that video models will lead to AGI by simulating everything. This is obviously false. In truth, only *hyper field networks* will lead to... something, by simulating everything. I've been trying to come up with a cool name like that for a while. Maybe it's not perfect, but it'll do for now.
Thoughts On World Models Thoughts On World Models The thing is, I'm kinda retarded. I mean I don't even know what Kolmogorov complexity is. Apparently it has something to do with algorithms and maybe information. These both seem like pretty important aspects of world models, so I should probably learn what Kolmogorov complexity is, but I'm not going to because it's 4:16 AM. Really I just want to write about the things already floating around in my head. Let's start with what I've heard about world models. To begin with, my simcluster has told me that language models are world models, and also
Explore this link on the map →related reading
- World Models: Computing the Uncomputablenotboring.co
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- LLMs and World Models, Part 1 - by Melanie Mitchellaiguide.substack.com
- World Models | Rohit Bandarurohitbandaru.github.io
- A Functional Taxonomy of World Models - Dr. Fei-Fei Lidrfeifei.substack.com
- The Model That Dreams the Worldmoe-capital.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- World Emulation via Neural Networkmadebyoll.in
- GenAI Handbookgenai-handbook.github.io
- RTFM: A Real-Time Frame Model | World Labsworldlabs.ai
- pdfopenreview.net
- Large Language Model: world models or surface statistics?thegradient.pub