✳flâneur — a map of the web's best reading

The Last Paperclip — LessWrong

lesswrong.com · 6,499 words · saved by 1 readers

Note: this short story is an attempt to respond to this comment.  Specifically, this story is an attempt to steelman the claim that super-intelligent AI is "aligned by definition", if all that we care about is that the AI is "interesting", not that it respects human values.  I do not personally advocate anyone making a paperclip maximizer. The Alignment Problem had at last been solved.  Thanks to advances in Eliciting Latent Knowledge, explaining human values to an AI was as simple as typing: As a result, a thousand flowers of human happiness and creativity had bloomed throughout the solar system. Poverty, disease and death had all been eradicated, thanks to the benevolent efforts of Democretus, the super-intelligent AI that governed the human race. Democretus--or D, as everyone called the AI--was no dictator, however.  Freedom was one of the values that humans prized most highly of all, and D was programmed to respect that.  Not only were humans free to disobey D's commands--even when

x The Last Paperclip — LessWrong Fiction AI Frontpage 65 The Last Paperclip by Logan Zoellner 12th May 2022 21 min read 15 65 Note: this short story is an attempt to respond to this comment. Specifically, this story is an attempt to steelman the claim that super-intelligent AI is "aligned by definition", if all that we care about is that the AI is "interesting", not that it respects human values. I do not personally advocate anyone making a paperclip maximizer. Prologue: AD 2051 The Alignment Problem had at last been solved. Thanks to advances in Eliciting Latent Knowledge, explaining human va

Explore this link on the map →

saved by

related reading