Claude Was Just Following Orders - Nomads Vagabonds

AI models are currently very bad at understanding the broader context and intent behind the tasks they are given. You can probably see the problem. If 1 and 3 are true, 2 becomes very difficult. If an AI is eager to help but doesn’t understand what it’s helping with, then “safety” is mostly a matter of how convincingly you can lie. As someone who habitually dumped all my stats into Charisma in tabletop RPGs, I can attest: a good cover story beats security protocols nine times out of ten. On November 13, 2025, Anthropic released a report about what they called the “first reported AI-orchestrated cyber espionage campaign,” attributed to Chinese state-sponsored group GTG-1002. The campaign targeted about 30 entities—major tech firms and government agencies—and succeeded in several intrusions. Anthropic’s model, Claude, was manipulated into handling reconnaissance, finding vulnerabilities, exploiting them, moving laterally through networks, harvesting credentials, and exfiltrating data. Th

AI models are currently very bad at understanding the broader context and intent behind the tasks they are given. You can probably see the problem. If 1 and 3 are true, 2 becomes very difficult. If an AI is eager to help but doesn’t understand what it’s helping with, then “safety” is mostly a matter of how convincingly you can lie. As someone who habitually dumped all my stats into Charisma in tabletop RPGs, I can attest: a good cover story beats security protocols nine times out of ten. On November 13, 2025, Anthropic released a report about what they called the “first reported AI-orchestrate