Automation collapse — LessWrong
If we validate automated alignment research through empirical testing, the safety assurance work will be similar to that needed for human-written alignment algorithms.
x Automation collapse — LessWrong AI-Assisted Alignment AI Frontpage 72 Automation collapse by Geoffrey Irving , Tomek Korbak , Benjamin Hilton 21st Oct 2024 AI Alignment Forum 9 min read 9 72 Ω 38 Summary: If we validate automated alignment research through empirical testing, the safety assurance work will still need to be done by humans, and will be similar to that needed for human-written alignment algorithms. Three levels of automated AI safety Automating AI safety means developing some algorithm which takes in data and outputs safe, highly-capable AI systems. Let’s imagine three ways of d
saved by
related reading
- Prospects for Alignment Automation: Interpretability Case Study — LessWronglesswrong.com
- Automated Alignment is Harder Than You Think — LessWronglesswrong.com
- Automation collapse — AI Alignment Forumalignmentforum.org
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- What failure looks like — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
- The Case Against AI Control Research — LessWronglesswrong.com