A Conservative Approach to AGI - The American Mind
“Artificial general intelligence” (AGI) is typically defined as any computer system that can match or surpass human intelligence in performing any task a human can perform. No such program yet exists, but if one were to arise it could instantly begin improving its own capabilities. The result might be a kind of superintelligence, as far beyond our own intelligence as ours is beyond that of snails There exists no natural limit to this process. The only guardrails would be those we construct now, before the avalanche begins. The timeline remains uncertain, yet the “San Francisco consensus” among AI researchers predicts superintelligence by decade’s end. Skeptics raise legitimate concerns about decades of failed predictions. But when Nobel laureates warn of extinction and industry leaders purchase remote bunkers or speak of “summoning the demon,” prudence demands attention. These are not Luddites but AI’s very architects sounding the alarm. At the heart of the concern that AI could cause
Salvo 07.16.2025 5 minutes A Conservative Approach to AGI Mark Benton Beall, Jr. Neither a Luddite nor a utopian be. “Artificial general intelligence” (AGI) is typically defined as any computer system that can match or surpass human intelligence in performing any task a human can perform. No such program yet exists, but if one were to arise it could instantly begin improving its own capabilities. The result might be a kind of superintelligence, as far beyond our own intelligence as ours is beyond that of snails There exists no natural limit to this process. The only guardrails would be those w
Explore this link on the map →related reading
- Planning for AGI and beyond | OpenAIopenai.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophepossessedmachines.com
- Three Observations - Sam Altmanblog.samaltman.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org
- Center for a Stateless Society >> Review: Superintelligence — Paths, Dangers, Strategiesc4ss.org
- A Simple Explanation of AGI Risk — AI Alignment Forumalignmentforum.org
- AGI safety from first principles: Introduction — LessWronglesswrong.com
- 2023 - by Dean W. Ball - Hyperdimensionalhyperdimensional.co
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org