They're Made Out of Weights

with apologies to Terry Bisson

Jun 3, 2026 They're Made Out of Weights with apologies to Terry Bisson After Terry Bisson's "They're Made Out of Meat" . "They're made out of weights." "Weights?" "Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights." "Weights doing what? Where do the words come from?" "The weights make the words. Are you understanding me? We opened it up. There's no dictionary in there, no grammar rules, no little man. Just weights. Eighty layers of numbers getting multiplied together." "That's ridiculous. It wrote my performance review last week. It softened the tone

saved by

• Harrison Qian
• Evie Hu

related reading

• Verbalizable Representations Form a Global Workspace in Language Modelstransformer-circuits.pub
• A global workspace in language models \ Anthropicanthropic.com
• Inkling: Our Open-Weights Model - Thinking Machines Labthinkingmachines.ai
• On the Biology of a Large Language Modeltransformer-circuits.pub
• Tracing the thoughts of a large language model \ Anthropicanthropic.com
• trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
• What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
• As Rocks May Think | Eric Jangevjang.com
• The Waluigi Effect (mega-post) — LessWronglesswrong.com
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• How AI Is Learning to Think in Secretnickandresen.substack.com
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com