Readings on the nature of alignment research – The Universe from an Intentional Stance

Overview: Relative to AI capabilities research, AI alignment research seems more conceptual/fuzzy/… I’ll first try to express a version of this point myself. But primarily this post serves as a mil…

Overview: Relative to AI capabilities research, AI alignment research seems more conceptual/fuzzy/… I’ll first try to express a version of this point myself. But primarily this post serves as a mildly curated reading list of texts by others making similar points. I’ll also give some examples of conceptual/fuzzy/… work in alignment research. In my mind, an important fact about alignment research (e.g., for figuring out how to automate it, for how to design work tests, how to organize the research community) is that it has in part the following cluster of properties: preparadigmatic;…

saved by

• Bhagyesh Kumar

related reading

• The Universe from an Intentional Stancecasparoesterheld.com
• Defining alignment research — LessWronglesswrong.com
• Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• LessWronglesswrong.com
• Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
• Automated Alignment is Harder Than You Think — LessWronglesswrong.com
• The Artificiality of Alignmentjoinreboot.org
• The Field of AI Alignment: A Postmortem, and What To Do About It — LessWronglesswrong.com
• A minimal viable product for alignment - by Jan Leikealigned.substack.com
• Jacob Pfau on Musings on the Alignment Problemaligned.substack.com
• Why I’m optimistic about our alignment approachaligned.substack.com