Readings on the nature of alignment research – The Universe from an Intentional Stance

Overview: Relative to AI capabilities research, AI alignment research seems more conceptual/fuzzy/… I’ll first try to express a version of this point myself. But primarily this post serves as a mil…

Overview: Relative to AI capabilities research, AI alignment research seems more conceptual/fuzzy/… I’ll first try to express a version of this point myself. But primarily this post serves as a mildly curated reading list of texts by others making similar points. I’ll also give some examples of conceptual/fuzzy/… work in alignment research. In my mind, an important fact about alignment research (e.g., for figuring out how to automate it, for how to design work tests, how to organize the research community) is that it has in part the following cluster of properties: preparadigmatic;…

saved by

• Bhagyesh Kumar

related reading

• “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
• The Universe from an Intentional Stancecasparoesterheld.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Defining alignment research — LessWronglesswrong.com
• Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
• Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
• The Artificiality of Alignmentjoinreboot.org
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• Automated Alignment is Harder Than You Think — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Neurotechnology is Critical for AI Alignmentmilan.cvitkovic.net