Simple Alpha Zero
This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind published a preprint of Alpha Zero on arXiv that extends AlphaGo Zero methods to Chess and Shogi.
Simple Alpha Zero A Simple Alpha(Go) Zero Tutorial 29 December 2017 This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind
Explore this link on the map →related reading
- AlphaGo Zero: Minimal Policy Improvement, Expectation Propagation and other Connectionsinference.vc
- A (Long) Peek into Reinforcement Learning | Lil'Loglilianweng.github.io
- EfficientZero: How It Works — LessWronglesswrong.com
- Frontier Coding Agents Can Now Implement an AlphaZero Self-Play Machine Learning Pipeline For Connect Four That Performs Comparably to an External Solver — LessWronglesswrong.com
- AlphaZero: Shedding new light on chess, shogi, and Go — Google DeepMinddeepmind.com
- Dominion AI – Temple Gatestemplegatesgames.com
- The 37 Implementation Details of Proximal Policy Optimization · The ICLR Blog Trackiclr-blog-track.github.io
- Monte Carlo tree search - Wikipediaen.wikipedia.org
- Monte Carlo Tree Search: An Introduction | Towards Data Sciencetowardsdatascience.com
- Learning Beyond Gradientstrinkle23897.github.io
- Deep Q-Networks Explained — LessWronglesswrong.com
- Deep Reinforcement Learning: Pong from Pixelskarpathy.github.io