AI as a science, and three obstacles to alignment strategies — LessWrong
AI used to be a science. In the old days (back when AI didn't work very well), people were attempting to develop a working theory of cognition. Those scientists didn’t succeed, and those days are behind us. For most people working in AI today and dividing up their work hours between tasks, gone is the ambition to understand minds. People working on mechanistic interpretability (and others attempting to build an empirical understanding of modern AIs) are laying an important foundation stone that could play a role in a future science of artificial minds, but on the whole, modern AI engineering is simply about constructing enormous networks of neurons and training them on enormous amounts of data, not about comprehending minds. The bitter lesson has been taken to heart, by those at the forefront of the field; and although this lesson doesn't teach us that there's nothing to learn about how AI minds solve problems internally, it suggests that the fastest path to producing more powerful sys
x AI as a science, and three obstacles to alignment strategies — LessWrong AI Development Pause AI Frontpage 198 AI as a science, and three obstacles to alignment strategies by So8res 25th Oct 2023 AI Alignment Forum 13 min read 80 198 Ω 81 AI used to be a science. In the old days (back when AI didn't work very well), people were attempting to develop a working theory of cognition. Those scientists didn’t succeed, and those days are behind us. For most people working in AI today and dividing up their work hours between tasks, gone is the ambition to understand minds. People working on mechanis
related reading
- “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Neurotechnology is Critical for AI Alignmentmilan.cvitkovic.net
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- Intentionally Designing the Future of AIgoodfire.ai
- Deep Deceptiveness — LessWronglesswrong.com
- The Case Against AI Control Research — LessWronglesswrong.com
- Designing AI for Disruptive Scienceasimov.press
- Defining alignment research — LessWronglesswrong.com
- Why AI alignment could be hard with modern deep learningcold-takes.com
- I Would Have Solved Alignment, But I Was Worried That Would Advance Timelines — LessWronglesswrong.com