Seven Strategies for Tackling the Hard Part of the Alignment Problem — AI Alignment Forum

Thanks to Michael Ripa for feedback. • TL;DR * There are two types of problems that AI systems can have: problems that we can observe during development and problems that we can’t. The hardest par…

x Eight Strategies for Tackling the Hard Part of the Alignment Problem — AI Alignment Forum AI Frontpage 18 Eight Strategies for Tackling the Hard Part of the Alignment Problem by scasper 8th Jul 2023 8 min read 11 18 Thanks to Michael Ripa for feedback. TL;DR There are two types of problems that AI systems can have: problems that we can observe during development and problems that we can’t. The hardest part of the alignment problem involves problems we can’t observe. I outline seven types of solutions for unobservable problems and taxonomize them based on whether they require that we know wha

related reading

• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• AGI Ruin: A List of Lethalities — LessWronglesswrong.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
• Alignment remains a hard, unsolved problem — AI Alignment Forumalignmentforum.org
• Research Areas in Evaluation and Guarantees in Reinforcement Learning (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org
• A gentle introduction to mechanistic anomaly detection — LessWronglesswrong.com
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• Neel Nanda on Mechanistic Interpretability: Progress, Limits, and Paths to Safer AI — EA Forumforum.effectivealtruism.org
• A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org
• Research Areas in Interpretability (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org