Actually, Othello-GPT Has A Linear Emergent World Representation — AI Alignment Forum
Note that this work has since been turned into a paper and published at BlackboxNLP. I think the paper version is more rigorous but much terser and l…
x Actually, Othello-GPT Has A Linear Emergent World Representation — AI Alignment Forum Interpreting Othello-GPT Interpretability (ML & AI) AI Frontpage 71 Actually, Othello-GPT Has A Linear Emergent World Representation by Neel Nanda 29th Mar 2023 Linkpost for neelnanda.io 23 min read 26 71 Note that this work has since been turned into a paper and published at BlackboxNLP. I think the paper version is more rigorous but much terser and less fun, and both it and this sequence of blog posts are worth reading in different ways Epistemic Status : This is a write-up of an experiment in speedrunnin
related reading
- Actually, Othello-GPT Has A Linear Emergent World Representation - Neel Nandaneelnanda.io
- [2210.13382] Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org
- Chess-GPT’s Internal World Model | Adam Karvonenadamkarvonen.github.io
- OthelloGPT learned a bag of heuristics — LessWronglesswrong.com
- Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org
- Othello-GPT: Reflections on the Research Process — LessWronglesswrong.com
- Othello-GPT: Reflections on the Research Process — LessWronglesswrong.com
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- Chapter 1: Transformer Interpretability - ARENAlearn.arena.education
- Simulators — LessWronglesswrong.com
- interpreting GPT: the logit lens — LessWronglesswrong.com
- An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2 — AI Alignment Forumalignmentforum.org