behind the scenes of paper writing
I received many kind comments about the conceptual clarity and figure design of my most recent paper, "Base Models Can Reason By Taking a Cue From Training Data", so I wanted to share how this project came to be and the approach I took to writing it. One of my goals as a researcher is to help people understand our findings by communicating them clearly, and to help others in their own research by sharing the process behind those findings. It is common to view communication as the final stage of research, as taught by the scientific method. For this paper, though, thinking about how to communicate our findings actually helped guide the research itself1. Some may find it unconventional that I storyboarded the figures before we even had the experimental results needed to produce them. In fact, we designed our experiments around the figures, rather than the other way around. This reflects what I value in a successful research project. In particular, I care about whether I can produce a cha
Pages of "Base Models Can Reason By Taking a Cue From Training Data". I received many kind comments about the conceptual clarity and figure design of my most recent paper, "Base Models Can Reason By Taking a Cue From Training Data", so I wanted to share how this project came to be and the approach I took to writing it. One of my goals as a researcher is to help people understand our findings by communicating them clearly, and to help others in their own research by sharing the process behind those findings. It is common to view communication as the final stage of research, as taught by the…
saved by
- Anosha Rahim
- Jackson Mowatt Gok
- Jaeho Lee
- ochre
- Alicia Zhou
- Ishaan Panigrahi
- Lailah Nabegu
- Kevin Zhang
- Miguel Villa Floran
related reading
- How to win a best paper award (or, an opinionated take on how to do important research)nicholas.carlini.com
- Sophie Wangsophielwang.com
- An Opinionated Guide to ML Researchjoschu.net
- Highly Opinionated Advice on How to Write ML Papers — LessWronglesswrong.com
- A Survival Guide to a PhDkarpathy.github.io
- Research as Understanding ∙ Kanjun Qiukanjun.me
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- Learning By Writingcold-takes.com
- My Research Process: Understanding and Cultivating Research Taste — AI Alignment Forumalignmentforum.org
- A model of research skill — LessWronglesswrong.com
- Templates for machine learning research papers | Neel Guhaneelguha.github.io
- Research Lessons I Learned at MATS & Redwoodlesswrong.com