Value is Fragile — LessWrong

lesswrong.com · 12,332 words · saved by 1 readers

If I had to pick a single statement that relies on more Overcoming Bias content I've written than any other, that statement would be: Any Future not shaped by a goal system with detailed reliable inheritance from human morals and metamorals, will contain almost nothing of worth. "Well," says the one, "maybe according to your provincial human values, you wouldn't like it. But I can easily imagine a galactic civilization full of agents who are nothing like you, yet find great value and interest in their own goals. And that's fine by me. I'm not so bigoted as you are. Let the Future go its own way, without trying to bind it forever to the laughably primitive prejudices of a pack of four-limbed Squishy Things -" My friend, I have no problem with the thought of a galactic civilization vastly unlike our own... full of strange beings who look nothing like me even in their own imaginations... pursuing pleasures and experiences I can't begin to empathize with... trading in a marketplace of

x Value is Fragile — LessWrong Value Theory Complexity of value Human Values Frontpage 191 Value is Fragile by Eliezer Yudkowsky 29th Jan 2009 7 min read 109 191 If I had to pick a single statement that relies on more Overcoming Bias content I've written than any other, that statement would be: Any Future not shaped by a goal system with detailed reliable inheritance from human morals and metamorals, will contain almost nothing of worth. "Well," says the one, "maybe according to your provincial human values, you wouldn't like it. But I can easily imagine a galactic civilization full of agents

Value is Fragile — LessWrong

related reading