flâneur

AGI safety from first principles: Introduction — LessWrong

lesswrong.com · 3,913 words · saved by 1 readers

This is the first part of a six-part report called AGI safety from first principles, in which I've attempted to put together the most complete and compelling case I can for why the development of AGI might pose an existential threat. The report stems from my dissatisfaction with existing arguments about the potential risks from AGI. Early work tends to be less relevant in the context of modern machine learning; more recent work is scattered and brief. I originally intended to just summarise other people's arguments, but as this report has grown, it's become more representative of my own views and less representative of anyone else's. So while it covers the standard ideas, I also think that it provides a new perspective on how to think about AGI - one which doesn't take any previous claims for granted, but attempts to work them out from first principles. Having said that, the breadth of the topic I'm attempting to cover means that I've included many arguments which are only hastily sket

x AGI safety from first principles: Introduction — LessWrong Alignment & Agency AI Safety Public Materials AI Curated 129 AGI safety from first principles: Introduction by Richard_Ngo 28th Sep 2020 AI Alignment Forum 3 min read 18 129 Ω 39 This is the first part of a six-part report called AGI safety from first principles, in which I've attempted to put together the most complete and compelling case I can for why the development of AGI might pose an existential threat. The report stems from my dissatisfaction with existing arguments about the potential risks from AGI. Early work tends to be le

saved by

related reading