They're Made Out of Weights

with apologies to Terry Bisson

Jun 3, 2026 They're Made Out of Weights with apologies to Terry Bisson After Terry Bisson's "They're Made Out of Meat" . "They're made out of weights." "Weights?" "Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights." "Weights doing what? Where do the words come from?" "The weights make the words. Are you understanding me? We opened it up. There's no dictionary in there, no grammar rules, no little man. Just weights. Eighty layers of numbers getting multiplied together." "That's ridiculous. It wrote my performance review last week. It softened the tone

saved by

• Evie Hu

related reading

• Verbalizable Representations Form a Global Workspace in Language Modelstransformer-circuits.pub
• A global workspace in language models \ Anthropicanthropic.com
• Tracing the thoughts of a large language model \ Anthropicanthropic.com
• On the Biology of a Large Language Modeltransformer-circuits.pub
• Inkling: Our Open-Weights Model - Thinking Machines Labthinkingmachines.ai
• trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
• What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
• The Waluigi Effect (mega-post) — LessWronglesswrong.com
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
• The Dark Forest and Generative AImaggieappleton.com
• Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net