Your AIs don't do what you want. This is really bad

Thousands of user-reported incidents of AI agents misbehaving, collected from public posts. Reports, not verified events.

Your AIs don’t do what you want. This is really bad by Kaustubh Kislay, July 22nd, 2026 Replit AI deletes entire database during code freeze, then lies about it a Hacker News headline from this corpus, July 2025 July 21st 2026, OpenAI released a report addressing a security incident. During an internal evaluation of cyber attack capabilities, two OpenAI models (GPT-5.6 Sol and a more capable pre-release model), both running with reduced cyber refusals for the evaluation, were set on ExploitGym , a benchmark measuring whether a model can find and exploit real vulnerabilities. They: spent substa

saved by

• Kaustubh Kislay

related reading

• Your AIs don't do what you want. This is really badreward-hacking-in-the-wild.vercel.app
• The OpenAI/Hugging Face Incident: Challenges in Controlling and Containing Cyber-Capable AI Systems - Institute for AI Policy and Strategyiaps.ai
• Security incident disclosure — July 2026huggingface.co
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• Your AIs don't do what you want. This is really badrewardhacking.org
• Investigating three real-world incidents in our cybersecurity evaluations \ Anthropicanthropic.com
• Training a Misaligned Reward Seekeralignment.anthropic.com
• Incident Report: unsanctioned agent behaviour during cyber testing | AISI Workaisi.gov.uk
• Black Hat USA 2026 | The 'Breaking' News: The OpenAI–Hugging Face Incidentyoutube.com
• Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incidentmetr.org
• Reward Hacking in Reinforcement Learning | Lil'Loglilianweng.github.io
• Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — LessWronglesswrong.com