What Is The Alignment Problem? — LessWrong

So we want to align future AGIs. Ultimately we’d like to align them to human values, but in the shorter term we might start with other targets, like…

x What Is The Alignment Problem? — LessWrong AI Curated 2025 Top Fifty: 16 % 184 What Is The Alignment Problem? by johnswentworth 16th Jan 2025 AI Alignment Forum 30 min read 49 184 Ω 65 So we want to align future AGIs. Ultimately we’d like to align them to human values, but in the shorter term we might start with other targets, like e.g. corrigibility . That problem description all makes sense on a hand-wavy intuitive level, but once we get concrete and dig into technical details… wait, what exactly is the goal again? When we say we want to “align AGI”, what does that mean? And what about the

related reading

• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Study Guide — LessWronglesswrong.com
• The self-unalignment problem — LessWronglesswrong.com
• The Artificiality of Alignmentjoinreboot.org
• “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
• Why Agent Foundations? An Overly Abstract Explanation — LessWronglesswrong.com
• Explore: AI alignmentarbital.greaterwrong.com
• Alignment Is Proven To Be Solvable - by SE Gygesverysane.ai
• Defining alignment research — LessWronglesswrong.com
• How To Go From Interpretability To Alignment: Just Retarget The Search — LessWronglesswrong.com
• What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
• The Alignment Problem — LessWronglesswrong.com