Fake Optimization Criteria — LessWrong
I've previously dwelt in considerable length upon forms of rationalization whereby our beliefs appear to match the evidence much more strongly than they actually do. And I'm not overemphasizing the point, either. If we could beat this fundamental metabias and see what every hypothesis really predicted, we would be able to recover from almost any other error of fact. The mirror challenge for decision theory is seeing which option a choice criterion really endorses. If your stated moral principles call for you to provide laptops to everyone, does that really endorse buying a $1 million gem-studded laptop for yourself, or spending the same money on shipping 5000 OLPCs? We seem to have evolved a knack for arguing that practically any goal implies practically any action. A phlogiston theorist explaining why magnesium gains weight when burned has nothing on an Inquisitor explaining why God's infinite love for all His children requires burning some of them at the stake. There's no mystery abo
x Fake Optimization Criteria — LessWrong The Simple Math of Evolution Motivated Reasoning Optimization Law and Legal systems Frontpage 85 Fake Optimization Criteria by Eliezer Yudkowsky 10th Nov 2007 3 min read 21 85 I've previously dwelt in considerable length upon forms of rationalization whereby our beliefs appear to match the evidence much more strongly than they actually do . And I'm not overemphasizing the point, either. If we could beat this fundamental metabias and see what every hypothesis really predicted, we would be able to recover from almost any other error of fact. The mirror ch
Explore this link on the map →related reading
- Humans are not automatically strategic — LessWronglesswrong.com
- Humans are not automatically strategic — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Thou Art Godshatter — LessWronglesswrong.com
- An Alien God — LessWronglesswrong.com
- Prolegomena to a Theory of Fun — LessWronglesswrong.com
- Heading Toward Morality — LessWronglesswrong.com
- Rationalization — LessWronglesswrong.com
- 2.5. Evolution and Ethics — LessWronglesswrong.com
- Value is Fragile — LessWronglesswrong.com
- Sequence Highlights — LessWronglesswrong.com
- Disguised Queries — LessWronglesswrong.com