✳flâneur — a map of the web's best reading

[Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now? — AI Alignment Forum

alignmentforum.org · 11,927 words · saved by 1 readers

This is the first of a series of blog posts on the technical safety problem for hypothetical future brain-like Artificial General Intelligence (AGI) systems. So my immediate priority here is saying what the heck is “the technical safety problem for brain-like AGI” and what do those words even mean and why on earth should I care. Summary of this first post: AGI is short for “Artificial General Intelligence”—I’ll get back to the definition of AGI in Section 1.4 below. AGI doesn’t exist right now, but I’ll argue in Section 1.7 that we can and should be preparing for AGI even today. The part I’ll be talking about in this series is the red box here: Specifically, we zoom in on a single team of humans who are trying to create a single AGI, and we want it to be possible for them to do so without winding up with some catastrophe that nobody wanted, with an out-of-control AGI self-replicating around the internet or whatever (more on which in Section 1.6). Blue boxes in this diagram are things t

x [Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now? — AI Alignment Forum Intro to Brain-Like-AGI Safety Neuromorphic AI AI Frontpage 57 [Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now? by Steven Byrnes 26th Jan 2022 34 min read 21 57 (Last revised: June 2026. See changelog at the bottom.) 1.1 Post summary / Table of contents This is the first of a series of blog posts on the technical safety problem for hypothetical future brain-like Artificial General Intelligence (AGI) systems . That previous sentence might raise a few questions, such as

Explore this link on the map →

related reading