Work

PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models

Year: 2021

Type: conference-paper

Source: International Conference on Machine Learning

Authors: Chaoyang He, Li Shen, Mahdi Soltanolkotabi, Salman Avestimehr

Institutions: University of Southern California, Meta (United States)

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

OpenAlex ID: W3169545043

FWCI: 2.436

Cites: 13

Cited by: 18

Related to: 10