Reflections on Qualitative Research
This note offers some opinionated thoughts on why interpretability research may have qualitative aspects be more central than we're used to in other fields. It also aims to describe some heuristics for research taste in qualitative work. Early scientific fields are often quite qualitative and become more quantitative as they mature. For example, discovering cells is a qualitative result, which can then mature (over many decades) into quantitative tools like counting white blood cells in cancer research. Discovering chemical spectral lines was a qualitative result, which only really became quantitative when Bohr realized that the "butterfly wings of atoms" gave insight into electron orbitals. The vast majority of researchers are trained in mature disciplines, because genuinely new scientific fields are rare. These mature disciplines have established paradigms, with established quantitative measures and methods. But interpretability is not a mature field. It doesn't have an established p
Reflections on Qualitative Research Transformer Circuits Thread Reflections on Qualitative Research Chris Olah, Adam Jermyn This note offers some opinionated thoughts on why interpretability research may have qualitative aspects be more central than we're used to in other fields. It also aims to describe some heuristics for research taste in qualitative work. Early scientific fields are often quite qualitative and become more quantitative as they mature. For example, discovering cells is a qualitative result, which can then mature (over many decades) into quantitative tools like counting white
Explore this link on the map →related reading
- Research Debtdistill.pub
- Research as Understanding ∙ Kanjun Qiukanjun.me
- How To Become A Mechanistic Interpretability Researcher — LessWronglesswrong.com
- How To Become A Mechanistic Interpretability Researcher — AI Alignment Forumalignmentforum.org
- Collecting Metrics During Qualitative Studies - NN/Gnngroup.com
- Research Taste Exercises [rough note] -- colah's blogcolah.github.io
- Assessing skeptical views of interpretability research | Christopher Pottsweb.stanford.edu
- Principles of Effective Research – Michael Nielsenmichaelnielsen.org
- The Hitchhiker's Guide to Actionable Interpretabilityactionable-interpretability-guide.github.io
- The Meta-Discursive UX Practice - Dscoutdscout.com
- My Research Process: Understanding and Cultivating Research Taste — LessWronglesswrong.com
- My Research Process: Understanding and Cultivating Research Taste — AI Alignment Forumalignmentforum.org