✳flâneur — a map of the web's best reading

Do people seriously worry about existential risk from AI?

aisafety.info · 799 words · saved by 1 readers

Many people with a deep understanding of AI are highly concerned about the risks of unaligned superintelligent AI. In 2023, leaders from the world’s top AI labs, along with some of the most prominent academic AI researchers, signed a statement that “Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.” Signatories included the founders of major AGI companies: Sam Altman1, Dario Amodei2, Shane Legg3 and Demis Hassabis4. Some of them, alongside Elon Musk, signed a letter calling for a pause to giant AI experiments. Stuart Russell, AI expert and co-author of the “authoritative textbook of the field of AI”5, warns of “species-ending problems” and wants his field to pivot to make superintelligence-related risks a central concern. His book Human Compatible focuses on the dangers of artificial intelligence and the need for more work to address them. The Turing Award is considered the equivalent of the Nob

Do people seriously worry about existential risk from AI? 6 min read Share this article Suggest changes in Google Docs Many people, including those with a deep understanding of AI, are highly concerned about the risks of unaligned superintelligent AI. The people building it Leaders of the world’s top AI companies have acknowledged the risks: OpenAI’s Sam Altman has called superintelligence “probably the greatest threat to the continued existence of humanity,” and said that if things go badly, it could mean “lights out for all of us.” Anthropic’s Dario Amodei has said that if a powerful model w

Explore this link on the map →

saved by

related reading