Work

Optimizing GPU Multiplexing for Efficient and Cost-Effective Access to Diverse Large Language Models in GPU Clusters

Year: 2024

Type: conference-paper

DOI: 10.1109/mascots64422.2024.10786517

Authors: Yue Zhu, Chen Wang, Max Calman, Rina Nakazawa, Eun Kyung Lee

Institutions: IBM (United States), IBM Research - Thomas J. Watson Research Center

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

OpenAlex ID: W4405362385

FWCI: 0.935

Cites: 14

Cited by: 3

Related to: 10