Simple Alpha Zero

This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind published a preprint of Alpha Zero on arXiv that extends AlphaGo Zero methods to Chess and Shogi.

Simple Alpha Zero A Simple Alpha(Go) Zero Tutorial 29 December 2017 This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind

related reading

• AlphaGo Zero: Minimal Policy Improvement, Expectation Propagation and other Connectionsinference.vc
• A (Long) Peek into Reinforcement Learning | Lil'Loglilianweng.github.io
• How Go Players Disempower Themselves to AI — LessWronglesswrong.com
• Deep Reinforcement Learning: Pong from Pixelskarpathy.github.io
• An Overview of Deep Learning for Curious People | Lil'Loglilianweng.github.io
• Learning To Play Settlers of Catan With Deep RLsettlers-rl.github.io
• AlphaZero: Shedding new light on chess, shogi, and Godeepmind.com
• The 37 Implementation Details of Proximal Policy Optimization · The ICLR Blog Trackiclr-blog-track.github.io
• EfficientZero: How It Works — LessWronglesswrong.com
• Deep Reinforcement Learning: Pong from Pixelskarpathy.github.io
• Deep Q-Networks Explained — LessWronglesswrong.com
• Grandmaster-Level Chess Without Searcharxiv.org