Work

Synthesizing optimal collective algorithms

Year: 2021

Type: conference-paper

Abstract: Collective communication algorithms are an important component of distributed computation. Indeed, in the case of deep-learning, collective communication is the Amdahl's bottleneck of data-parallel training.

Source: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

DOI: 10.1145/3437801.3441620

Authors: Zixian Cai, Zhengyang Liu, Saeed Maleki, Madanlal Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi

Institutions: Australian National University, University of Utah, Microsoft (United States)

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W3072623287

FWCI: 5.272

Cites: 13

Cited by: 71

Related to: