Categorizing failures as “outer” or “inner” misalignment is often confused - AI Alignment Forum
alignmentforum.org · 4,194 words · saved by 1 readers
Pop quiz: Are the following failures examples of outer or inner misalignment? Or is it ambiguous? …
x Categorizing failures as “outer” or “inner” misalignment is often confused — AI Alignment Forum Inner Alignment Outer Alignment AI Frontpage 47 Categorizing failures as “outer” or “inner” misalignment is often confused by Rohin Shah 6th Jan 2023 9 min read 21 47 Pop quiz: Are the following failures examples of outer or inner misalignment? Or is it ambiguous? (I’ve spoilered the scenarios so you look at each one separately and answer before moving on to the next. Even if you don’t want to actually answer, you should read through the scenarios for the rest of the post to make sense.) Scenario
related reading
- Outer vs inner misalignment: three framings — AI Alignment Forumalignmentforum.org
- Outer vs inner misalignment: three framings — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
- Another (outer) alignment failure story — AI Alignment Forumalignmentforum.org
- What failure looks like — AI Alignment Forumalignmentforum.org
- What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- Self-Other Overlap: A Neglected Approach to AI Alignment — LessWronglesswrong.com
- How far does alignment midtraining generalize?alignment.openai.com