Understand, align, cooperate: AI welfare and AI safety are allies
experiencemachines.substack.com · 2,455 words · saved by 1 readers
Win-win solutions and low-hanging fruit
In conversations about AI safety and AI welfare, people sometimes frame them as inherently opposing goals: either we protect humans (AI safety), or we protect AI systems (AI welfare). This framing implies a tragic, necessary choice: whose side are you on? Or it suggests, at least, “shouldn’t we solve safety first, and then worry about AI welfare?” But the truth is that this is a false choice: fortunately, many of the best interventions for protecting AI systems will also protect humans, and vice versa. To be sure, there are genuine tensions between AI safety and AI welfare.1 But if we only…
saved by
related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Neurotechnology is Critical for AI Alignmentmilan.cvitkovic.net
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org
- AI Safety Seems Hard to Measurecold-takes.com
- Efficient tradeoffs and the safety-usefulness tradeoff model — LessWronglesswrong.com
- Reframing AI Safety as a Neverending Institutional Challenge – Stephen Casperstephencasper.com