Work

TorchBraid: High-Performance Layer-Parallel Training of Deep Neural Networks with MPI and GPU Acceleration

Year: 2025

Type: article

Source: ACM Transactions on Mathematical Software

DOI: 10.1145/3759244

Authors: Eric C. Cyr, Jens Hahne, Nicholas S. Moore, Jacob B. Schroder, Ben S. Southworth, David A. Vargas

Institutions: Sandia National Laboratories, University of Wuppertal, West Texas A&M University, University of New Mexico, Los Alamos National Laboratory

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funders: Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung, Los Alamos National Laboratory

Awards: G5726497713, G6684765602

OpenAlex ID: W4413382536

FWCI:

Cites: 44

Cited by:

Related to: 10