Racing through a minefield: the AI deployment problem
cold-takes.com · 4,010 words · saved by 3 readers
Push AI forward too fast, and catastrophe could occur. Too slow, and someone else less cautious could do it. Is there a safe course?
Click lower right to download or find on Apple Podcasts, Spotify, Stitcher, etc. In previous pieces, I argued that there's a real and large risk of AI systems' developing dangerous goals of their own and defeating all of humanity - at least in the absence of specific efforts to prevent this from happening. I discussed why it could be hard to build AI systems without this risk and how it might be doable . The “AI alignment problem” refers 1 to a technical problem: how can we design a powerful AI system that behaves as intended, rather than forming its own dangerous aims ? This post is going to
saved by
related reading
- The Artificiality of Alignmentjoinreboot.org
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- How to pace the US frontierblog.aifutures.org
- Nearcast-based "deployment problem" analysis — AI Alignment Forumalignmentforum.org
- AI Safety Seems Hard to Measurecold-takes.com
- What failure looks like — AI Alignment Forumalignmentforum.org
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Pacing The Frontier: An Agendapacing.tech
- The AI Arms Race Isn’t Inevitablepalladiummag.com
- Does AI Progress Have a Speed Limit?—Asteriskasteriskmag.com
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance