Actually, Othello-GPT Has A Linear Emergent World Representation — AI Alignment Forum
Note that this work has since been turned into a paper and published at BlackboxNLP. I think the paper version is more rigorous but much terser and l…
x Actually, Othello-GPT Has A Linear Emergent World Representation — AI Alignment Forum Interpreting Othello-GPT Interpretability (ML & AI) AI Frontpage 71 Actually, Othello-GPT Has A Linear Emergent World Representation by Neel Nanda 29th Mar 2023 Linkpost for neelnanda.io 23 min read 26 71 Note that this work has since been turned into a paper and published at BlackboxNLP. I think the paper version is more rigorous but much terser and less fun, and both it and this sequence of blog posts are worth reading in different ways Epistemic Status : This is a write-up of an experiment in speedrunnin
Explore this link on the map →related reading
- Actually, Othello-GPT Has A Linear Emergent World Representation - Neel Nandaneelnanda.io
- [2210.13382] Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org
- Large Language Model: world models or surface statistics?thegradient.pub
- Chapter 1: Transformer Interpretability - ARENAlearn.arena.education
- Chess-GPT’s Internal World Model | Adam Karvonenadamkarvonen.github.io
- Structure and Interpretation of Deep Networkssidn.baulab.info
- OthelloGPT learned a bag of heuristics — LessWronglesswrong.com
- Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Manipulating Chess-GPT’s World Model | Adam Karvonenadamkarvonen.github.io
- Othello-GPT: Reflections on the Research Process — LessWronglesswrong.com
- Othello-GPT: Reflections on the Research Process — LessWronglesswrong.com