What is prosaic alignment?
Prosaic AI alignment is an approach to alignment research that assumes that future artificial general intelligence (AGI) will be developed "prosaically" — i.e., without "reveal[ing] any fundamentally new ideas about the nature of intelligence or turn[ing] up any 'unknown unknowns.'" In other words, it assumes the AI technique...
Prosaic AI alignment is an approach to alignment research that assumes that future artificial general intelligence (AGI) will be developed "prosaically" — i.e., without "reveal[ing] any fundamentally new ideas about the nature of intelligence or turn[ing] up any 'unknown unknowns.'" In other words, it assumes the AI techniques we're already using are sufficient to produce AGI if scaled far enough. Because of this assumption, prosaic alignment research is often relatively concrete and empirical, evaluating the effectiveness of proposed alignment techniques by trying them out on existing AI…
saved by
related reading
- Readings on the nature of alignment researchcasparoesterheld.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org
- Is Prosaic Alignment Research Useful If the First Takeover-Capable AI Is Not an LLM? — RedWronglw.shlegeris.com
- The Artificiality of Alignmentjoinreboot.org
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- The Universe from an Intentional Stancecasparoesterheld.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
- A minimal viable product for alignment - by Jan Leikealigned.substack.com