A Case for Model Persona Research — LessWrong
Context: At the Center on Long-Term Risk (CLR) our empirical research agenda focuses on studying (malicious) personas, their relation to generalizati…
x A Case for Model Persona Research — LessWrong LLM Personas AI Frontpage 2025 Top Fifty: 15 % 121 A Case for Model Persona Research by nielsrolf , Maxime Riché , Daniel Tan 15th Dec 2025 5 min read 11 121 Context: At the Center on Long-Term Risk (CLR) our empirical research agenda focuses on studying (malicious) personas, their relation to generalization, and how to prevent misgeneralization, especially given weak overseers (e.g., undetected reward hacking) or underspecified training signals. This has motivated our past research on Emergent Misalignment and Inoculation Prompting , and we want
related reading
- The Persona Selection Model: Why AI Assistants might Behave like Humansalignment.anthropic.com
- From personas to intentions: towards a science of motivations for AI models — LessWronglesswrong.com
- Thousand-dimensional structure — Resolutionresolution.org
- llm assistant personas seem increasingly incoherent (some subjective observations) — LessWronglesswrong.com
- The persona selection model — LessWronglesswrong.com
- Thoughts on the persona selection modellesswrong.com
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- Persona Features Control Emergent Misalignmentarxiv.org
- [2507.21509] Persona Vectors: Monitoring and Controlling Character Traits in Language Modelsarxiv.org
- The Case Against AI Control Research — LessWronglesswrong.com
- A Three-Layer Model of LLM Psychology — LessWronglesswrong.com