marlbenchmark/on-policy: This is the official implementation of Multi-Agent PPO (MAPPO).
This repository implements MAPPO, a multi-agent variant of PPO. The implementation in this repositorory is used in the paper "The Surprising Effectiveness of PPO in Cooperative Multi-Agent Games" (https://arxiv.org/abs/2103.01955). This repository is heavily based on https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail. We also make the off-policy repo public, please feel free to try that. off-policy link All hyperparameters and training curves are reported in appendix, we would strongly suggest to double check the important factors before runing the code, such as the rollout threads, episode length, ppo epoch, mini-batches, clip term and so on. Besides, we have updated the newest results on google football testbed and suggestions about the episode length and parameter-sharing in appendix, welcome to check that. We have recently noticed that a lot of papers do not reproduce the mappo results correctly, probably due to the rough hyper-parameters description. We have updated training
MAPPO New Update!!!We support SMAC V2 now~ Chao Yu*, Akash Velu*, Eugene Vinitsky, Jiaxuan Gao, Yu Wang, Alexandre Bayen, and Yi Wu. This repository implements MAPPO, a multi-agent variant of PPO. The implementation in this repositorory is used in the paper "The Surprising Effectiveness of PPO in Cooperative Multi-Agent Games" ( https://arxiv.org/abs/2103.01955 ). This repository is heavily based on https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail . We also make the off-policy repo public, please feel free to try that. off-policy link All hyperparameters and training curves are reporte
Explore this link on the map →related reading
- The 37 Implementation Details of Proximal Policy Optimization · The ICLR Blog Trackiclr-blog-track.github.io
- JaxMARL: Multi-Agent RL, but 10000x Fasterblog.foersterlab.com
- GitHub - FLAIROx/JaxMARL: Multi-Agent Reinforcement Learning with JAX · GitHubgithub.com
- A vision researcher’s guide to some RL stuff: PPO & GRPO - Yuge (Jimmy) Shiyugeten.github.io
- Composer2.pdfcursor.com
- MARLlib: A Multi-agent Reinforcement Learning Library — MARLlib v1.0.0 documentationmarllib.readthedocs.io
- A Graphic Guide to Implementing PPO for Atari Games | Towards Data Sciencetowardsdatascience.com
- HANABI – np – ( ´ ▽ ` )ノnphard.io
- Learning Beyond Gradientstrinkle23897.github.io
- MAAC/algorithms/attention_sac.py at master · shariqiqbal2810/MAAC · GitHubgithub.com
- VGC-Bench: Towards Mastering Diverse Team Strategies in Competitive Pokémonarxiv.org
- GitHub - karpathy/autoresearch: AI agents running research on single-GPU nanochat training automatically · GitHubgithub.com