Building Technology to Drive AI Governance
Technically skilled people who care about AI going well often ask me: how should I spend my time if I think AI governance is important? By governance, I mean the constraints, incentives, and oversight that govern how AI is developed. One option is to focus on technical work that solves
Technically skilled people who care about AI going well often ask me: how should I spend my time if I think AI governance is important? By governance, I mean the constraints, incentives, and oversight that govern how AI is developed. One option is to focus on technical work that solves problems at the point of production, such as alignment research or safeguards. Another common instinct is to get directly involved in policy: switching to a policy role, funding advocacy, or lobbying policymakers. But internal technical work does little to shift the broader incentives of AI development: without
saved by
related reading
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- AI Governance Needs Technical Work — EA Forumforum.effectivealtruism.org
- On Private Governancehyperdimensional.co
- Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
- Towards a sociotechnical ecology of artificial intelligence: power, accountability, and governance in a global contextlink.springer.com
- [2304.04914] Regulatory Markets: The Future of AI Governancearxiv.org
- How Do We Govern AI Well? — LessWronglesswrong.com
- A Long Sequence of Small, Correct Decisionscalebwatney.substack.com
- Breaking the Intelligence Curse - The Intelligence Curseintelligence-curse.ai
- How to Actually Spend Billions on AI Safetythecounterfactual.substack.com
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- Governance of AI, with AI, through deliberative democracyreimagine.aviv.me