Thoughts on responsible scaling policies and regulation — LessWrong

I am excited about AI developers implementing responsible scaling policies; I’ve recently been spending time refining this idea and advocating for it. Most people I talk to are excited about RSPs, but there is also some uncertainty and pushback about how they relate to regulation. In this post I’ll explain my views on that: I think AI developers are not prepared to work with very powerful AI systems. They don’t have the scientific understanding to deploy superhuman AI systems without considerable risk, and they do not have the security or internal controls to even safely train such models. If protective measures didn’t improve then I think the question would be when rather than if development should be paused. I think the safest action in an ideal world would be pausing immediately until we were better prepared (though see the caveats in the next section). But the current level of risk is low enough that I think it is defensible for companies or countries to continue AI development if

x Thoughts on responsible scaling policies and regulation — LessWrong Responsible Scaling Policies AI Governance AI Development Pause AI Community Frontpage 220 Thoughts on responsible scaling policies and regulation by paulfchristiano 24th Oct 2023 AI Alignment Forum 7 min read 34 220 Ω 103 I am excited about AI developers implementing responsible scaling policies ; I’ve recently been spending time refining this idea and advocating for it. Most people I talk to are excited about RSPs, but there is also some uncertainty and pushback about how they relate to regulation. In this post I’ll explai

related reading

• Responsible Scaling Policy v3 — LessWronglesswrong.com
• RSPs are pauses done right — EA Forumforum.effectivealtruism.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Policy ideas for mitigating AI risk — EA Forumforum.effectivealtruism.org
• Responsible Scaling Policy Version 3.0 \ Anthropicanthropic.com
• Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com
• Responsible Scaling Policies (RSPs) - METRmetr.org
• Responsible Scaling Policies (RSPs) - METRevals.alignment.org
• Dario Amodei’s prepared remarks from the AI Safety Summit on Anthropic’s Responsible Scaling Policy \ Anthropicanthropic.com
• The current bottleneck is political will, not research — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com