An Analysis on Inference Time, Accuracy, Communication, and GPU Memory Usage for Inference Batch of Large Language Models
Year: 2024
Type: article
Source: 한국통신학회논문지
Authors: Changyong Shin, Younghun Go, Yeonho Yoo, Gyeongsik Yang, Chuck Yoo
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: closed
OpenAlex ID: W4404493451