AI Regulation is Unsafe — LessWrong
Concerns over AI safety and calls for government control over the technology are highly correlated but they should not be. There are two major forms of AI risk: misuse and misalignment. Misuse risks come from humans using AIs as tools in dangerous ways. Misalignment risks arise if AIs take their own actions at the expense of human interests. Governments are poor stewards for both types of risk. Misuse regulation is like the regulation of any other technology. There are reasonable rules that the government might set, but omission bias and incentives to protect small but well organized groups at the expense of everyone else will lead to lots of costly ones too. Misalignment regulation is not in the Overton window for any government. Governments do not have strong incentives to care about long term, global, costs or benefits and they do have strong incentives to push the development of AI forwards for their own purposes. Noticing that AI companies put the world at risk is not enough to su
x AI Regulation is Unsafe — LessWrong Regulation and AI Risk AI Governance Politics AI World Optimization Frontpage 40 AI Regulation is Unsafe by Maxwell Tabarrok 22nd Apr 2024 Linkpost for www.maximum-progress.com 5 min read 41 40 Concerns over AI safety and calls for government control over the technology are highly correlated but they should not be. There are two major forms of AI risk: misuse and misalignment. Misuse risks come from humans using AIs as tools in dangerous ways. Misalignment risks arise if AIs take their own actions at the expense of human interests. Governments are poor ste
Explore this link on the map →related reading
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Dario Amodei — Policy on the AI Exponentialdarioamodei.com
- Policy ideas for mitigating AI risk — EA Forumforum.effectivealtruism.org
- Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com
- Notes from the Lighthaven Daniel Kokotajlo & Dean Ball debatejasminexli.substack.com
- Ways I Expect AI Regulation To Increase X-Risk1a3orn.com
- Planning for AGI and beyond | OpenAIopenai.com
- FAQ on Catastrophic AI Risks | Yoshua Bengioyoshuabengio.org
- Strategic Visionsstatic1.squarespace.com
- Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- AI Alignment Cannot Be Top-Down | AI Frontiersai-frontiers.org