Caspar Oesterheld
casparoesterheld.com · 9,379 words · saved by 2 readers
A blog on Philosophy, Artificial Intelligence and Effective Altruism
Overview: Relative to AI capabilities research, AI alignment research seems more conceptual/fuzzy/… I’ll first try to express a version of this point myself. But primarily this post serves as a mildly curated reading list of texts by others making similar points. I’ll also give some examples of conceptual/fuzzy/… work in alignment research. In my mind, an important fact about alignment research (e.g., for figuring out how to automate it, for how to design work tests, how to organize the research community) is that it has in part the following cluster of properties: preparadigmatic;…
saved by
related reading
- Shtetl-Optimized >> Blog Archive >> Theory and AI Alignmentscottaaronson.blog
- Readings on the nature of alignment researchcasparoesterheld.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- Defining alignment research — LessWronglesswrong.com
- The Case Against AI Control Research — LessWronglesswrong.com
- Differential acceleration of alignment-relevant capabilities is a bad bet — LessWronglesswrong.com
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org
- Alignment & Succession: The Two Bars of Alignmentnosetgauge.com