World Emulation via Neural Network
I turned a forest trail near my apartment into a playable neural world. You can explore that world in your web browser by clicking right here: By “neural world”, I mean that the entire thing is a neural network generating new images based on previous images + controls. There is no level geometry, no code for lighting or shadows, no scripted animation. Just a neural net in a loop. By “in your web browser” I mean this world runs locally, in your web browser. Once the world has loaded, you can continue exploring even in Airplane Mode. So, why bother creating a world this way? There are some interesting conceptual reasons (I’ll get to them later), but my main goal was just to outdo a prior post. See, three years ago, I got a simple two-dimensional video game world to run in-browser by training a neural network to mimic gameplay videos from YouTube. Mimicking a 2D video game world was cute, but ultimately kind of pointless; existing video games already exist and we can already emulate them
World Emulation via Neural Network World Emulation via Neural Network 25 April 2025 I turned a forest trail near my apartment into a playable neural world. You can explore that world in your web browser by clicking right here : By "neural world", I mean that the entire thing is a neural network generating new images based on previous images + controls. There is no level geometry, no code for lighting or shadows, no scripted animation. Just a neural net in a loop. By "in your web browser" I mean this world runs locally, in your web browser. Once the world has loaded, you can continue exploring
Explore this link on the map →related reading
- Game Emulation via Neural Networkmadebyoll.in
- World Models: Computing the Uncomputablenotboring.co
- The World Inside Neural Networksgoodfire.ai
- World Models | Rohit Bandarurohitbandaru.github.io
- The Model That Dreams the Worldmoe-capital.com
- Thoughts On World Modelshaydendonnelly.net
- A Functional Taxonomy of World Models - Dr. Fei-Fei Lidrfeifei.substack.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- NeRF: Neural Radiance Fieldsmatthewtancik.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- 3D as code | World Labsworldlabs.ai
- The flavor of the bitter lesson for computer vision - Vincent Sitzmannvincentsitzmann.com