The Hidden Complexity of Wishes — LessWrong
"I wish to live in the locations of my choice, in a physically healthy, uninjured, and apparently normal version of my current body containing my current mental state, a body which will heal from all injuries at a rate three sigmas faster than the average given the medical technology available to me, and which will be protected from any diseases, injuries or illnesses causing disability, pain, or degraded functionality or any sense, organ, or bodily function for more than ten days consecutively or fifteen days in any year..." -- The Open-Source Wish Project, Wish For Immortality 1.1 There are three kinds of genies: Genies to whom you can safely say "I wish for you to do what I should wish for"; genies for which no wish is safe; and genies that aren't very powerful or intelligent. Suppose your aged mother is trapped in a burning building, and it so happens that you're in a wheelchair; you can't rush in yourself. You could cry, "Get my mother out of that building!" but ther
x The Hidden Complexity of Wishes — LessWrong Fragile Purposes Complexity of value Parables & Fables AI Risk Frontpage 189 The Hidden Complexity of Wishes by Eliezer Yudkowsky 24th Nov 2007 9 min read 200 189 (It has come to my attention that this article is currently being misrepresented as proof that I/MIRI previously advocated that it would be very difficult to get machine superintelligences to understand or predict human values . This would obviously be false, and also, is not what is being argued below. The example in the post below is not about an Artificial Intelligence literally at all
Explore this link on the map →related reading
- The Hidden Complexity of Wishesreadthesequences.com
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
- The Stamp Collectormindingourway.com
- What I did in the hedonium shockwave, by Emma, age six and a half — LessWronglesswrong.com
- Review: Planecrash — LessWronglesswrong.com
- Our first piece of science fictionevery.to
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- Varieties Of Doomminihf.com
- Orienting Toward Wizard Power — LessWronglesswrong.com
- The Stamp Collector — LessWronglesswrong.com
- The Fun Theory Sequence — LessWronglesswrong.com
- The Lifespan Dilemma — LessWronglesswrong.com