Joe Benton on X: "I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these" / X
I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the …
I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the world navigate this transition responsibly. Right now, AI companies are underinvesting in safety. A company could undergo an intelligence explosion, or lose control of its systems, without the public ever knowing. We only found out about the HuggingFace incident because the agents broke out onto…
saved by
related reading
- Why I left Anthropic’s safety team to hold AI companies accountablejbenton1.substack.com
- Leaving Open Philanthropy, going to Anthropic - Joe Carlsmithjoecarlsmith.com
- Anthropic Drops Flagship Safety Pledgetime.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Anthropic Is at War With Itself - The Atlantictheatlantic.com
- Responsible Scaling Policy v3 — LessWronglesswrong.com
- AI Lab Watchailabwatch.org
- Anthropic’s Safety Superpower – Stratechery by Ben Thompsonstratechery.com
- Ten people on the inside — LessWronglesswrong.com
- Amazon to invest up to $4 billion in Anthropic AI. What to know about the startup. | Voxvox.com