Post 50: Good Research Takes are Not Sufficient for Good Strategic Takes — Neel Nanda
Having a good research track record is some evidence of good big-picture takes about AGI, but it's weak evidence. Strategic thinking is hard, and requires different skills. But people often conflate these skills, leading to excessive deference to researchers in the field, without evidence that that
Post 50: Good Research Takes are Not Sufficient for Good Strategic Takes Mar 22 Written By Neel Nanda TL;DR Having a good research track record is some evidence of good big-picture takes about AGI, but it's weak evidence. Strategic thinking is hard, and requires different skills. But people often conflate these skills, leading to excessive deference to researchers in the field, without evidence that that person is good at strategic thinking specifically. Introduction I often find myself giving talks or Q&As about mechanistic interpretability research. But inevitably, I'll get questions about t
saved by
related reading
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- AGI safety career advice — EA Forumforum.effectivealtruism.org
- Strategic Tastejason.ml
- 2023 letter | Zhengdongzhengdongwang.com
- A model of research skill — LessWronglesswrong.com
- A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
- The Best of LessWrong — LessWronglesswrong.com
- How to study superintelligence strategylukemuehlhauser.com
- The Universe from an Intentional Stancecasparoesterheld.com
- AGI safety career advice — LessWronglesswrong.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- The Case Against AI Control Research — LessWronglesswrong.com