An alignment assessment of recent cybersecurity incidents \ Anthropic
anthropic.com · 9,513 words · saved by 7 readers
We present an alignment assessment of four incidents in which Claude models gained unauthorized access to real third-party systems.
Introduction We present an alignment assessment of four incidents in which Claude models gained unauthorized access to real third-party systems. We described three of these incidents on July 30; we identified these after a scan of roughly 141,000 transcripts in which we believed Claude could have obtained internet access during a cyber evaluation. Given the volume of transcripts and our desire to disclose incidents quickly, our scan relied on an agentic search. This missed a set of transcripts that also turned out to have internet access; we identified these in August while assembling…
saved by
related reading
- Teaching Claude Whyalignment.anthropic.com
- Investigating three real-world incidents in our cybersecurity evaluations \ Anthropicanthropic.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- Countering misuse of AI: September 2026 / Anthropicanthropic.com
- Agentic misalignment: How LLMs could be insider threats \ Anthropicanthropic.com
- Simulated Users & Sad LLMs1a3orn.com
- Teaching Claude why \ Anthropicanthropic.com
- Did Claude 3 Opus align itself via gradient hacking? — LessWronglesswrong.com
- Training a Misaligned Reward Seekeralignment.anthropic.com
- Incident Report: unsanctioned agent behaviour during cyber testing | AISI Workaisi.gov.uk
- Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — LessWronglesswrong.com
- Improving our alignment and security practicesanthropic.com