Work

ZeRO: Memory Optimization Towards Training A Trillion Parameter Models.

Year: 2019

Type: article

Authors: Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

OpenAlex ID: W2977720775

FWCI: 13.07

Cites: 4

Cited by: 69

Related to: 10