Why does training on insecure code make models broadly misaligned?

WASHINGTON, D.C. — June 4, 2025 — FAR.AI successfully launched the inaugural Technical Innovations for AI Policy Conference, creating a vital bridge between cutting-edge AI research and actionable policy solutions. The two-day gathering (May 31–June 1) convened more than 150 technical experts, researchers, and policymakers to address the most pressing challenges at the intersection of AI technology and governance.

Why does training on insecure code make models broadly misaligned? We updated our website and would love your feedback! Events Events Programs Programs Blog About About Careers Donate Back to All News Why does training on insecure code make models broadly misaligned? Full PDF Project Source Citation June 17, 2025 Chris Cundy Summary FOR IMMEDIATE RELEASE FAR.AI Launches Inaugural Technical Innovations for AI Policy Conference, Connecting Over 150 Experts to Shape AI Governance ‍ WASHINGTON, D.C. — June 4, 2025 — FAR.AI successfully launched the inaugural Technical Innovations for AI Policy Con

related reading

• [2502.17424] Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMsarxiv.org
• Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs 49 This paper contains model-generated content that might be offensive. 49arxiv.org
• Open problems in emergent misalignment — LessWronglesswrong.com
• Model Organisms for Emergent Misalignment — LessWronglesswrong.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Teaching Claude why \ Anthropicanthropic.com
• Off Target | CNAScnas.org
• Natural-emergent-misalignment-from-reward-hacking-paper.pdfassets.anthropic.com
• Model Organisms for Emergent Misalignmentarxiv.org
• Narrow Misalignment is Hard, Emergent Misalignment is Easy — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com