flâneur

Policy Gradient Algorithms | Lil'Log

lilianweng.github.io · 11,108 words · saved by 8 readers

[Updated on 2018-06-30: add two new policy gradient methods, SAC and D4PG.] [Updated on 2018-09-30: add a new policy gradient method, TD3.] [Updated on 2019-02-09: add SAC with automatically adjusted temperature]. [Updated on 2019-06-26: Thanks to Chanseok, we have a version of this post in Korean]. [Updated on 2019-09-12: add a new policy gradient method SVPG.] [Updated on 2019-12-22: add a new policy gradient method IMPALA.] [Updated on 2020-10-15: add a new policy gradient method PPG & some new discussion in PPO.] [Updated on 2021-09-19: Thanks to Wenhao & 爱吃猫的鱼, we have this post in Chinese1 & Chinese2].

Table of Contents What is Policy Gradient Notations Policy Gradient Policy Gradient Theorem Proof of Policy Gradient Theorem Policy Gradient Algorithms REINFORCE Actor-Critic Off-Policy Policy Gradient A3C A2C DPG DDPG D4PG MADDPG TRPO PPO PPG ACER ACTKR SAC SAC with Automatically Adjusted Temperature TD3 SVPG IMPALA Quick Summary References [Updated on 2018-06-30: add two new policy gradient methods, SAC and D4PG .] [Updated on 2018-09-30: add a new policy gradient method, TD3 .] [Updated on 2019-02-09: add SAC with automatically adjusted temperature ]. [Updated on 2019-06-26: Thanks to Chans

saved by

related reading