Why We Need to Think Bigger in AI Policy (Literally)
Frontier AI systems — state-of-the-art neural networks and the infrastructure built around them such as input/output filters and access controls — require especially strong governance. They are currently being abused in harmful ways such as assisting with fraud and cyberattacks; they will soon make it much easier to carry out novel biological weapon attacks; and sufficiently capable AI systems could resist human oversight and either seize, or be used to seize, enormous amounts of power. Yesterday’s frontier systems quickly become today’s mundane tools, but at any given time, we should pay particular attention to frontier AI systems. Urgent action is needed, and we shouldn’t let perfect be the enemy of good. But we need to make sure we’re heading in the right general direction. This post is about one way in which we might be off course. Thanks for reading Miles’s Substack! Subscribe for free to receive new posts and support my work. Most (though not all) thinking on AI safety, security,
Frontier AI systems — state-of-the-art neural networks and the infrastructure built around them such as input/output filters and access controls — require especially strong governance. They are currently being abused in harmful ways such as assisting with fraud and cyberattacks; they will soon make it much easier to carry out novel biological weapon attacks; and sufficiently capable AI systems could resist human oversight and either seize, or be used to seize, enormous amounts of power. Yesterday’s frontier systems quickly become today’s mundane tools, but at any given time, we should pay…
related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
- The Case Against AI Control Research — LessWronglesswrong.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Your Solution Doesn't Know Your Problem Existsblog.atlascomputing.org
- The case for ensuring that powerful AIs are controlledblog.redwoodresearch.org
- What Should Be Donehyperdimensional.co
- Frontier AI Regulation | GovAIgovernance.ai
- AI Safety Seems Hard to Measurecold-takes.com
- The End-State Fallacy: Where Is AI Security Headed?endstatefallacy.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance