Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training

Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training Alham Fikri Aji author Kenneth Heafield author Nikolay Bogoychev author 2019-11 text Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) Kentaro Inui editor Jing Jiang editor Vincent Ng editor Xiaojun Wan editor Association for Computational Linguistics Hong Kong, China conference publication aji-etal-2019-combining 10.18653/v1/D19-1373 https://aclanthology.org/D19-1373/ 2019-11 3626 3631