Why I left Anthropic’s safety team to hold AI companies accountable

Two weeks ago, I left the safety team at Anthropic.

Two weeks ago, I left the safety team at Anthropic. I will soon be joining METR, an independent organization that evaluates how safe AI companies’ systems are. I’d planned to write about that decision in more detail at some point, but Jacob’s resignation this week made me want to say more now. Like Jacob, I believe that AI companies are on track to impose an unprecedented level of risk on society. AI capabilities are already improving extremely fast, and the companies are trying to go even faster. Frontier AI companies are racing to build AI systems that can recursively self-improve. The…

saved by

• Ishaan Panigrahi
• Leonard Tang

related reading

• Joe Benton (@JoeJBenton) on Xx.com
• Leaving Open Philanthropy, going to Anthropic - Joe Carlsmithjoecarlsmith.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
• Dario Amodei — The Adolescence of Technologydarioamodei.com
• Dario Amodei — We Must Pace the Frontierdarioamodei.com
• Anthropic Drops Flagship Safety Pledgetime.com
• Anthropic Is at War With Itself - The Atlantictheatlantic.com
• Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
• Anthropic’s Safety Superpower – Stratechery by Ben Thompsonstratechery.com
• Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
• Pacing the Frontierpacingthefrontier.com