Memory-efficient tensor parallelism for long-sequence Transformer training
Year: 2025
Type: article
Authors: Peng Liang, Linbo Qiao, Yanqi Shi, Hao Zheng, Yu Tang, Dongsheng Li
Institution: National University of Defense Technology
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: closed
OpenAlex ID: W4409131506