How ARENA course material gets made — LessWrong

lesswrong.com · 2,904 words · saved by 1 readers

In this post, I describe my methodology for building new material for ARENA. I'll mostly be referring to the exercises on IOI, Superposition and Function Vectors as case studies. I expect this to be useful for people who are interested in designing material for ARENA or ARENA-like courses, as well as people who are interested in pedagogy or ML paper replications. The process has 3 steps: I'm mostly basing this on the following 3 sets of exercises: The steps I go through are listed below. I'm indexing from zero because I'm a software engineer so of course I am. The steps assume you already have an idea of what exercises you want to create; in Appendix (1) you can read some thoughts on what makes for a good exercise set. When creating material, you don't want to be starting from scratch. It's useful to have source code available to browse - bonus points if that takes the form of a Colab or something which is self-contained and has easily visible output. The first thing I'd done in each o

x How ARENA course material gets made — LessWrong Distillation & Pedagogy Interpretability (ML & AI) Machine Learning (ML) Skill Building AI Frontpage 41 How ARENA course material gets made by CallumMcDougall 2nd Jul 2024 9 min read 2 41 TL;DR In this post, I describe my methodology for building new material for ARENA. I'll mostly be referring to the exercises on IOI, Superposition and Function Vectors as case studies. I expect this to be useful for people who are interested in designing material for ARENA or ARENA-like courses, as well as people who are interested in pedagogy or ML paper repl

How ARENA course material gets made — LessWrong

related reading