Work

SloMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Year: 2020

Type: conference-paper

Source: International Conference on Learning Representations

Authors: Jianyu Wang, Vinayak Tantia, Nicolas Ballas, Michael Rabbat

Institutions: Carnegie Mellon University, Meta (Israel)

Language: English

Topic: Stochastic Gradient Optimization Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

OpenAlex ID: W2996693845

FWCI: 2.756

Cites: 41

Cited by: 34

Related to: 10