How can we solve diffuse threats like research sabotage with AI control?

Preventing research sabotage will require techniques very different from the original control paper.

How can we solve diffuse threats like research sabotage with AI control? Preventing research sabotage will require techniques very different from the original control paper. Vivek Hebbar Apr 30, 2025 9 Share Misaligned AIs might engage in research sabotage: making safety research go poorly by doing things like withholding their best ideas or putting subtle bugs in experiments. To mitigate this risk with AI control, we need very different techniques than those in the original control paper or Ctrl-Z , because research sabotage differs from those settings in two crucial ways: Firstly, the AI can

saved by

• Arjun Khandelwal

related reading

• How can we solve diffuse threats like research sabotage with AI control? — LessWronglesswrong.com
• How can we solve diffuse threats like research sabotage with AI control?redwoodresearch.substack.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Thoughts on the conservative assumptions in AI controlblog.redwoodresearch.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• Research Areas in AI Control (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
• gdm-ai-control-roadmap.pdfstorage.googleapis.com
• 7+ tractable directions in AI control — AI Alignment Forumalignmentforum.org
• [2312.06942] AI Control: Improving Safety Despite Intentional Subversionarxiv.org