✳flâneur — a map of the web's best reading
Chess-GPT’s Internal World Model | Adam Karvonen
adamkarvonen.github.io · 3,539 words · saved by 1 readers
A Chess-GPT Linear Emergent World Representation
A Chess-GPT Linear Emergent World Representation Introduction Note: This work has since been turned into a paper accepted to the Conference on Language Modeling , but the average reader will probably prefer the blog post. There is also a second blog post, Manipulating Chess-GPT’s World model . Among the many recent developments in ML, there were two I found interesting and wanted to dig into further. The first was gpt-3.5-turbo-instruct ’s ability to play chess at 1800 Elo . The fact that an LLM could learn to play chess well from random text scraped off the internet seemed almost magical. The
Explore this link on the map →saved by
related reading
- Manipulating Chess-GPT’s World Model | Adam Karvonenadamkarvonen.github.io
- [2210.13382] Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org
- Playing chess with large language modelsnicholas.carlini.com
- Actually, Othello-GPT Has A Linear Emergent World Representation - Neel Nandaneelnanda.io
- Actually, Othello-GPT Has A Linear Emergent World Representation — AI Alignment Forumalignmentforum.org
- Large Language Model: world models or surface statistics?thegradient.pub
- LLM Chess: Benchmarking Reasoning and Instruction-Following in LLMs through Chessarxiv.org
- A Very Unlikely Chess Game | Slate Star Codexslatestarcodex.com
- OthelloGPT learned a bag of heuristics — LessWronglesswrong.com
- AI Chess Leaderboard - dubesor AI projectdubesor.de
- Chapter 1: Transformer Interpretability - ARENAlearn.arena.education
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com