AI Regulation is Unsafe — LessWrong

Concerns over AI safety and calls for government control over the technology are highly correlated but they should not be. There are two major forms of AI risk: misuse and misalignment. Misuse risks come from humans using AIs as tools in dangerous ways. Misalignment risks arise if AIs take their own actions at the expense of human interests. Governments are poor stewards for both types of risk. Misuse regulation is like the regulation of any other technology. There are reasonable rules that the government might set, but omission bias and incentives to protect small but well organized groups at the expense of everyone else will lead to lots of costly ones too. Misalignment regulation is not in the Overton window for any government. Governments do not have strong incentives to care about long term, global, costs or benefits and they do have strong incentives to push the development of AI forwards for their own purposes. Noticing that AI companies put the world at risk is not enough to su

x AI Regulation is Unsafe — LessWrong Regulation and AI Risk AI Governance Politics AI World Optimization Frontpage 40 AI Regulation is Unsafe by Maxwell Tabarrok 22nd Apr 2024 Linkpost for www.maximum-progress.com 5 min read 41 40 Concerns over AI safety and calls for government control over the technology are highly correlated but they should not be. There are two major forms of AI risk: misuse and misalignment. Misuse risks come from humans using AIs as tools in dangerous ways. Misalignment risks arise if AIs take their own actions at the expense of human interests. Governments are poor ste

related reading

• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com
• Ways I Expect AI Regulation To Increase X-Risk1a3orn.com
• Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• The case for ensuring that powerful AIs are controlledblog.redwoodresearch.org
• Policy ideas for mitigating AI risk — EA Forumforum.effectivealtruism.org
• Thoughts on the conservative assumptions in AI controlblog.redwoodresearch.org
• Racing through a minefield: the AI deployment problemcold-takes.com
• Brain dump on the diversity of AI risk | Jascha’s blogsohl-dickstein.github.io