Joe Benton on X: "I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these" / X
I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the …
I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why. AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the world navigate this transition responsibly. Right now, AI companies are underinvesting in safety. A company could undergo an intelligence explosion, or lose control of its systems, without the public ever knowing. We only found out about the HuggingFace incident because the agents broke out onto…
saved by
related reading
- Why I left Anthropic’s safety team to hold AI companies accountablejbenton1.substack.com
- Leaving Open Philanthropy, going to Anthropic - Joe Carlsmithjoecarlsmith.com
- Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- I'm Switching Into AI Safetyalexirpan.com
- Anthropic Drops Flagship Safety Pledgetime.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Anthropic’s Safety Superpower – Stratechery by Ben Thompsonstratechery.com
- Responsible Scaling Policy v3 — LessWronglesswrong.com
- Anthropic's leading researchers acted as moderate accelerationists — LessWronglesswrong.com
- Amazon to invest up to $4 billion in Anthropic AI. What to know about the startup. | Voxvox.com
- You Need A Theory of Victory - by Jason Hausenloyfirstscattering.com