My take on Jacob Cannell’s take on AGI safety — LessWrong
Jacob Cannell wrote some blog posts about AGI safety / alignment and neuroscience between 2010 and 2015, which I read and enjoyed quite early on when I was first getting interested in the same topics a few years ago. So I was delighted to see him reappear on Lesswrong a year ago where he has been a prolific and thought-provoking blogger and commenter (in his free time while running a startup!). See complete list of Jacob’s blog posts and comments. Having read a bunch of his writings, and talked to him in various blog comments sections, I thought it would be worth trying to write up the places where he and I seem to agree and disagree. This exercise will definitely be helpful for me, hopefully helpful for Jacob, and maybe helpful for people who are already pretty familiar with at least one of our two perspectives. (My perspective is here.) I’m not sure how helpful it will be for everyone else. In particular, I’m probably skipping over, without explanation, important areas where Jacob &
x My take on Jacob Cannell’s take on AGI safety — LessWrong AI Boxing (Containment) Neuromorphic AI Neuroscience Evolutionary Psychology AI World Modeling Frontpage 72 My take on Jacob Cannell’s take on AGI safety by Steven Byrnes 28th Nov 2022 AI Alignment Forum 36 min read 15 72 Ω 25 Jacob Cannell wrote some blog posts about AGI safety / alignment and neuroscience between 2010 and 2015, which I read and enjoyed quite early on when I was first getting interested in the same topics a few years ago. So I was delighted to see him reappear on Lesswrong a year ago where he has been a prolific and
Explore this link on the map →related reading
- AGI safetysjbyrnes.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- AI 2027ai-2027.com
- My AGI safety research—2024 review, ’25 plans — AI Alignment Forumalignmentforum.org
- Commentary on AGI Safety from First Principles — AI Alignment Forumalignmentforum.org
- [Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now? — AI Alignment Forumalignmentforum.org
- Planning for AGI and beyond | OpenAIopenai.com
- The Best of LessWrong — LessWronglesswrong.com
- Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
- My AGI safety research—2025 review, ’26 plans — AI Alignment Forumalignmentforum.org
- “Sharp Left Turn” discourse: An opinionated review — LessWronglesswrong.com
- Cyborgism — LessWronglesswrong.com