Simple Alpha Zero

This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind published a preprint of Alpha Zero on arXiv that extends AlphaGo Zero methods to Chess and Shogi.

Simple Alpha Zero A Simple Alpha(Go) Zero Tutorial 29 December 2017 This tutorial walks through a synchronous single-thread single-GPU (read malnourished) game-agnostic implementation of the recent AlphaGo Zero paper by DeepMind. It's a beautiful piece of work that trains an agent for the game of Go through pure self-play without any human knowledge except the rules of the game. The methods are fairly simple compared to previous papers by DeepMind, and AlphaGo Zero ends up beating AlphaGo (trained using data from expert games and beat the best human Go players) convincingly. Recently, DeepMind

related reading

• AlphaGo Zero: Minimal Policy Improvement, Expectation Propagation and other Connectionsinference.vc
• Eric Jang (@ericjang11) on Xx.com
• A (Long) Peek into Reinforcement Learning | Lil'Loglilianweng.github.io
• AlphaZero: Shedding new light on chess, shogi, and Godeepmind.com
• EfficientZero: How It Works — LessWronglesswrong.com
• Frontier Coding Agents Can Now Implement an AlphaZero Self-Play Machine Learning Pipeline For Connect Four That Performs Comparably to an External Solver — LessWronglesswrong.com
• Deep Reinforcement Learning: Pong from Pixelskarpathy.github.io
• Dominion AI – Temple Gatestemplegatesgames.com
• GitHub - karpathy/autoresearch: AI agents running research on single-GPU nanochat training automaticallygithub.com
• The 37 Implementation Details of Proximal Policy Optimization · The ICLR Blog Trackiclr-blog-track.github.io
• Monte Carlo tree search - Wikipediaen.wikipedia.org
• Deep Reinforcement Learning: Pong from Pixelskarpathy.github.io