Model Plurality
Current research in “plural alignment” concentrates on making AI models amenable to diverse human values. But plurality is not simply a safeguard against bias or an engine of efficiency: it's a key ingredient for intelligence itself. Or copy link Efforts to align AI to what is safe or desirable consistently run into the problem of diverse perspectives on what exactly constitutes safe or desirable. Rather than facing the decision of ranking one worldview over another, a growing number of machine learning researchers have instead called for building pluralistic AI, hoping to cram a single model with a set of interchangeable value systems spanning the entire repertoire of cultural moral primitives. These efforts are focused on achieving values plurality: making large language models (LLMs) like ChatGPT amenable to a spread of human values rather than biased towards a single, politicized perspective. “Pluralistic alignment” research defines several possible forms of values plurality in mod
Or copy link Copy By Christina Lu Efforts to align AI to what is safe or desirable consistently run into the problem of diverse perspectives on what exactly constitutes safe or desirable . Rather than facing the decision of ranking one worldview over another, a growing number of machine learning researchers have instead called for building pluralistic AI, hoping to cram a single model with a set of interchangeable value systems spanning the entire repertoire of cultural moral primitives. These efforts are focused on achieving values plurality : making large language models (LLMs) like ChatGPT
related reading
- The Artificiality of Alignmentjoinreboot.org
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org
- Full-Stack Alignment and Thick Models of Valuefull-stack-alignment.ai
- Why I Am a Pluralist - RadicalxChangeradicalxchange.org
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- Value Alignment Is a Pseudo Conceptzilanqian.substack.com
- Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentalignmentpretraining.ai
- Alignment Is Proven To Be Solvable - by SE Gygesverysane.ai
- Thoughts on the Alignment Implications of Scaling Language Models | Leo Gaobmk.sh
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- Scaling: The State of Play in AIoneusefulthing.org