Models are cultures
When we train a machine learning model, on a corpus of human-produced media, fine-tune it on specific examples, and give it feedback on its interpretation of these things, we are doing something similar to the production of a culture. Historical human cultures were formed by a mixture of exchange, innovation and divergence. They gave rise to different languages, philosophies, artistic styles, economic systems, and forms of social organisation. Each new generation learns about the world from a mixture of personal experience and the stories and explanations given to them by the culture they grow up in. Pre-literate cultures had very narrow bandwidth for communicating their ideas between generations, and used myth and storytelling to encode the information that they valued most highly. These stories were densely interwoven mixtures of factual history, conceptual world-view, and ethical guidance, maintained and evolved by poets, priests and prophets. Everything else had to be learned and p
When we train a machine learning model, on a corpus of human-produced media, fine-tune it on specific examples, and give it feedback on its interpretation of these things, we are doing something similar to the production of a culture . Historical human cultures were formed by a mixture of exchange, innovation and divergence. They gave rise to different languages, philosophies, artistic styles, economic systems, and forms of social organisation. Each new generation learns about the world from a mixture of personal experience and the stories and explanations given to them by the culture they gro
Explore this link on the map →related reading
- trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
- Introducing talkie: a 13B vintage language model from 1930talkie-lm.com
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- Is there a looming Cultural Omnicide? — LessWronglesswrong.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- GenAI Handbookgenai-handbook.github.io
- On Shoggothimbactra.org
- Large Language Model: world models or surface statistics?thegradient.pub
- Little Free Language Modelswritefutureslab.com
- LLMs and World Models, Part 1 - by Melanie Mitchellaiguide.substack.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com