The Metamorphosis of Prime Intellect: Singularity
One thing that has happened since I wrote this novel in 1994 is that a number of people have begun actively planning for the kind of transition depicted in the novel. Collectively they have coined the term Singularity for the event when a smarter-than-human AI drops an explosion of new modalities on us. The novel touches on several topics which are being specifically addressed by Singularity theorists. Seed AI Programmer Fucks Up Friendliness Because the novel's Change effectively happens in 1988, Lawrence works in igorance of some really ground-breaking work that has been done lately defining the kind of goal system which might prevent the Second Law lock-out situation that occurs in the novel. According to these theories, Prime Intellect is under-engineered in several important ways. Most importantly the Three Laws do not draw a distinction between local short-term goals that might apply to projects, and "supergoals" which define one's reason for existence, ethical system, and so on.
The Metamorphosis of Prime Intellect: Singularity The Metamorphosis of Prime Intellect A Novel by Roger Williams   Prime Intellect and the Singularity One thing that has happened since I wrote this novel in 1994 is that a number of people have begun actively planning for the kind of transition depicted in the novel. Collectively they have coined the term Singularity for the event when a smarter-than-human AI drops an explosion of new modalities on us. The novel touches on several topics which are being specifically addressed by Singularity theorists. Seed AI Programmer Fucks Up Friendlines
Explore this link on the map →related reading
- The Coming Technological Singularityedoras.sdsu.edu
- The Gentle Singularity - Sam Altmanblog.samaltman.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- The Coming Technological Singularitydavidsholz.com
- Staring into the Singularity 1.2.5web.archive.org
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophepossessedmachines.com
- Infinite midwit - by Adam Mastroianniexperimental-history.com
- Import AI 458: Reckoning with the future; and a singularity story | Import AIjack-clark.net
- The Merge - Sam Altmanblog.samaltman.com
- Prolegomena to a Theory of Fun — LessWronglesswrong.com