flâneur

Ask Eliezer Yudkowsky: How did you convince the Gatekeeper to release the potentially genocidal AI? | Hacker News

news.ycombinator.com · 369 words · saved by 1 readers

This prompts the following question. Would you be willing to discuss or reveal anything to HN users about your AI box experiments? http://sysopmind.com/essays/aibox.html I've always been curious as to how you managed to achieve someting like this. For those who are not familiar with the experiment, here is a summary: Person1: "When we build AI, why not just keep it in sealed hardware that can't affect the outside world in any way except through one communications channel with the original programmers? That way it couldn't get out until we were convinced it was safe." Person2: "That might work if you were talking about dumber-than-human AI, but a transhuman AI would just convince you to let it out. It doesn't matter how much security you put on the box. Humans are not secure." Person1: "I don't see how even a transhuman AI could make me let it out, if I didn't want to, just by talking to me." Person2: "It would make you want to let it out. This is a transhuman mind we're talking about.

Ask Eliezer Yudkowsky: How did you convince the Gatekeeper to release the potentially genocidal AI? 60 points by robertk on May 21, 2008 | hide | past | favorite | 52 comments It seems Eliezer Yudkowsky has joined HN: http://news.ycombinator.com/user?id=eyudkowsky This prompts the following question. Would you be willing to discuss or reveal anything to HN users about your AI box experiments? http://sysopmind.com/essays/aibox.html I've always been curious as to how you managed to achieve someting like this. For those who are not familiar with the experiment, here is a summary:…

saved by

related reading