Anthropic Fall 2023 Debate Progress Update — AI Alignment Forum

This is a research update on some work that I’ve been doing on Scalable Oversight at Anthropic, based on the original AI safety via debate proposal a…

x Anthropic Fall 2023 Debate Progress Update — AI Alignment Forum Debate (AI safety technique) World Modeling Frontpage 32 Anthropic Fall 2023 Debate Progress Update by Ansh Radhakrishnan 28th Nov 2023 15 min read 9 32 This is a research update on some work that I’ve been doing on Scalable Oversight at Anthropic, based on the original AI safety via debate proposal and a more recent agenda developed at NYU and Anthropic. The core doc was written several months ago, so some of it is likely outdated, but it seemed worth sharing in its current form. I’d like to thank Tamera Lanham, Sam Bowman, Kam

related reading

• The limits of AI safety via debate — LessWronglesswrong.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• The Case Against AI Control Research — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• An alignment safety case sketch based on debate — LessWronglesswrong.com
• An AI alignment research agenda based on asymmetric debate and monitoring. — LessWronglesswrong.com