The Soul of EA is in Trouble — EA Forum
There’s a trend towards people who once identified as Effective Altruists now identifying solely as “people working on AI safety.”[1] For those in the loop, it feels like less of a trend and more of a tidal wave. There’s an increasing sense that among the most prominent (formerly?) EA orgs and individuals, making AGI go well is functionally all that matters. For that end, so the trend goes, the ideas of Effective Altruism have exhausted their usefulness. They pointed us to the right problem – thanks; we’ll take it from here. And taking it from here means building organizations, talent bases, and political alliances at a scale incommensurate with attachment to a niche ideology or moralizing language generally. I think this a dangerous path to go down too hard and my impression is the EAs are going down the path quite hard. I’ll acknowledge right off the bat that it is emphatically not the case that everyone doing some version of rebranding themselves to AI safety is making a mistake at
Will Aldred 1y * 71 7 0 4 Inspired by the last section of this post (and by a later comment from Mjreard), I thought it’d be fun—and maybe helpful—to taxonomize the ways in which mission or value drift can arise out of the instrumental goal of pursuing influence/reach/status/allies: Epistemic status: caricaturing things somewhat Never turning back the wheel In this failure mode, you never lose sight of how x-risk reduction is your terminal goal. However, in your two-step plan of ‘gain influence, then deploy that influence to reduce x-risk,’ you wait too long to move onto step two, and never ge
Explore this link on the map →related reading
- What failure looks like — LessWronglesswrong.com
- Changing the world for the worse — LessWronglesswrong.com
- Notes on Effective Altruismmichaelnotebook.com
- Doing EA Better — EA Forumforum.effectivealtruism.org
- You will be OK — LessWronglesswrong.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Saving Everyone, Everywhere, Across Space and Time - 34th Street Magazine34st.com
- Focus on the places where you feel shocked everyone's dropping the ball — LessWronglesswrong.com
- x-risk-themed — LessWronglesswrong.com
- My Model Of EA Burnout — LessWronglesswrong.com
- University EA Groups Need Fixing — EA Forumforum.effectivealtruism.org