The case for countermeasures to memetic spread of misaligned values — LessWrong

As various people have written about before, AIs that have long-term memory might pose additional risks (most notably, LLM AGI will have memory, and…

x The case for countermeasures to memetic spread of misaligned values — LessWrong Redwood Research AI Frontpage 83 The case for countermeasures to memetic spread of misaligned values by Alex Mallen 28th May 2025 AI Alignment Forum 8 min read 8 83 Ω 46 As various people have written about before, AIs that have long-term memory might pose additional risks (most notably, LLM AGI will have memory, and memory changes alignment by Seth Herd). Even if an AI is aligned or only occasionally scheming at the start of a deployment, the AI might become a consistent and coherent behavioral schemer via updat

saved by

• Dillon Nguyen

related reading

• The case for countermeasures to memetic spread of misaligned valuesblog.redwoodresearch.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• Many arguments for AI x-risk are wrong — AI Alignment Forumalignmentforum.org
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• Deep Deceptiveness — LessWronglesswrong.com
• Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com