Disguised Queries — LessWrong
Imagine that you have a peculiar job in a peculiar factory: Your task is to take objects from a mysterious conveyor belt, and sort the objects into two bins. When you first arrive, Susan the Senior Sorter explains to you that blue egg-shaped objects are called "bleggs" and go in the "blegg bin", while red cubes are called "rubes" and go in the "rube bin". Once you start working, you notice that bleggs and rubes differ in ways besides color and shape. Bleggs have fur on their surface, while rubes are smooth. Bleggs flex slightly to the touch; rubes are hard. Bleggs are opaque; the rube's surface slightly translucent. Soon after you begin working, you encounter a blegg shaded an unusually dark blue—in fact, on closer examination, the color proves to be purple, halfway between red and blue. Yet wait! Why are you calling this object a "blegg"? A "blegg" was originally defined as blue and egg-shaped—the qualification of blueness appears in the very name "blegg", in fact. This object
x Disguised Queries — LessWrong A Human's Guide to Words Philosophy of Language Parables & Fables Frontpage 197 Disguised Queries by Eliezer Yudkowsky 9th Feb 2008 5 min read 108 197 Imagine that you have a peculiar job in a peculiar factory: Your task is to take objects from a mysterious conveyor belt, and sort the objects into two bins. When you first arrive, Susan the Senior Sorter explains to you that blue egg-shaped objects are called "bleggs" and go in the "blegg bin", while red cubes are called "rubes" and go in the "rube bin". Once you start working, you notice that bleggs and rubes di
related reading
- Words as Hidden Inferences — LessWronglesswrong.com
- How An Algorithm Feels From Inside — LessWronglesswrong.com
- Please don't throw your mind away — LessWronglesswrong.com
- Words as Hidden Inferencesreadthesequences.com
- How An Algorithm Feels From Inside — LessWronglesswrong.com
- Guessing the Teacher's Password — LessWronglesswrong.com
- Taboo Your Words — LessWronglesswrong.com
- Making Beliefs Pay Rent (in Anticipated Experiences) — LessWronglesswrong.com
- Taboo Your Words — LessWronglesswrong.com
- The Categories Were Made For Man, Not Man For The Categories | Slate Star Codexslatestarcodex.com
- Mysterious Answers to Mysterious Questions — LessWronglesswrong.com
- Dark Side Epistemology — LessWronglesswrong.com