Decentralized Distributed Proximal Policy Optimization (DD-PPO)

Source code
https://github.com/fatalfeel/DD-PPO_Pytorch

Basic Practice
http://www.mediafire.com/file/wppwwbnug30namg/allreduce_basic.py

Recommend process backend cpu/gloo and gpu/nccl
https://pytorch.org/docs/stable/distributed.html

Basic Theory
1. All reduce: (view image in firefox correctly)
https://pytorch.org/tutorials/_images/all_reduce.png

2. All reduce usage tutorial
https://pytorch.org/tutorials/intermediate/dist_tuto.html

3. DistributedDataParallel (DDP) another function support for all reduce
https://pytorch.org/tutorials/intermediate/ddp_tutorial.html

Refer to:
https://arxiv.org/pdf/1911.00357.pdf
https://www.jishuwen.com/d/pg2J/zh-tw
https://zhuanlan.zhihu.com/p/64813912
https://github.com/seba-1511/dist_tuto.pth/blob/gh-pages/train_dist.py
https://github.com/seba-1511/dist_tuto.pth/blob/gh-pages/allreduce.py
https://github.com/facebookresearch/habitat-api/tree/master/habitat_baselines/rl/ddppo

Tesla told in New York Herald: I prefer to be remembered as the inventor who succeeded in abolishing war. That will be my highest pride.
http://www.teslacollection.com/tesla_articles/1898/new_york_herald/f_l_christman/tesla_declares_he_will_abolish_war (in middle section)

Albert Einstein: The release of atom power has changed everything except our way of thinking... the solution to this problem lies in the heart of mankind. If only I had known, I should have become a watchmaker.
https://atomictrauma.wordpress.com/the-scientists/albert-einstein