flâneur — a map of the web's best reading

The Metamorphosis of Prime Intellect: Singularity

localroger.com · 2,016 words · saved by 1 readers

One thing that has happened since I wrote this novel in 1994 is that a number of people have begun actively planning for the kind of transition depicted in the novel. Collectively they have coined the term Singularity for the event when a smarter-than-human AI drops an explosion of new modalities on us. The novel touches on several topics which are being specifically addressed by Singularity theorists. Seed AI Programmer Fucks Up Friendliness Because the novel's Change effectively happens in 1988, Lawrence works in igorance of some really ground-breaking work that has been done lately defining the kind of goal system which might prevent the Second Law lock-out situation that occurs in the novel. According to these theories, Prime Intellect is under-engineered in several important ways. Most importantly the Three Laws do not draw a distinction between local short-term goals that might apply to projects, and "supergoals" which define one's reason for existence, ethical system, and so on.

The Metamorphosis of Prime Intellect: Singularity The Metamorphosis of Prime Intellect A Novel by Roger Williams &nbsp Prime Intellect and the Singularity One thing that has happened since I wrote this novel in 1994 is that a number of people have begun actively planning for the kind of transition depicted in the novel. Collectively they have coined the term Singularity for the event when a smarter-than-human AI drops an explosion of new modalities on us. The novel touches on several topics which are being specifically addressed by Singularity theorists. Seed AI Programmer Fucks Up Friendlines

Explore this link on the map →

related reading