Value is Fragile — LessWrong
If I had to pick a single statement that relies on more Overcoming Bias content I've written than any other, that statement would be: Any Future not shaped by a goal system with detailed reliable inheritance from human morals and metamorals, will contain almost nothing of worth. "Well," says the one, "maybe according to your provincial human values, you wouldn't like it. But I can easily imagine a galactic civilization full of agents who are nothing like you, yet find great value and interest in their own goals. And that's fine by me. I'm not so bigoted as you are. Let the Future go its own way, without trying to bind it forever to the laughably primitive prejudices of a pack of four-limbed Squishy Things -" My friend, I have no problem with the thought of a galactic civilization vastly unlike our own... full of strange beings who look nothing like me even in their own imaginations... pursuing pleasures and experiences I can't begin to empathize with... trading in a marketplace of
x Value is Fragile — LessWrong Value Theory Complexity of value Human Values Frontpage 191 Value is Fragile by Eliezer Yudkowsky 29th Jan 2009 7 min read 109 191 If I had to pick a single statement that relies on more Overcoming Bias content I've written than any other, that statement would be: Any Future not shaped by a goal system with detailed reliable inheritance from human morals and metamorals, will contain almost nothing of worth. "Well," says the one, "maybe according to your provincial human values, you wouldn't like it. But I can easily imagine a galactic civilization full of agents
Explore this link on the map →related reading
- No Easy Eutopia: Why Great Futures Are Hard to Achieveforethought.org
- Prolegomena to a Theory of Fun — LessWronglesswrong.com
- The Fun Theory Sequence — LessWronglesswrong.com
- The Shard Theory of Human Valuesturntrout.com
- The shard theory of human values — LessWronglesswrong.com
- What’s Your P(WEIRD)? — LessWronglesswrong.com
- Convergence and Compromise: Will Society Aim for Good Futures?forethought.org
- The expected value of extinction risk reduction is positive — EA Forumforum.effectivealtruism.org
- Terminal Values and Instrumental Values — LessWronglesswrong.com
- Heading Toward Morality — LessWronglesswrong.com
- You don't get to know what you're fighting formindingourway.com
- ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com