Work

Aegaeon: Effective GPU Pooling for Concurrent LLM Serving on the Market

Year: 2025

Type: conference-paper

Source: ACM SIGOPS Symposium on Operating Systems Principles (SOSP)

DOI: 10.1145/3731569.3764815

Authors: Yuxing Xiang, Xue Li, Kun Qian, Yufan Yang, Diwen Zhu, Wenyuan Yu, Ennan Zhai, Xuanzhe Liu, Xin Jin, Jingren Zhou

Institutions: Peking University, Alibaba Group (China)

Language: English

Topic: Cloud Computing and Resource Management

Subfield: Information Systems

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funders: National Natural Science Foundation of China, National Key Research and Development Program of China

Awards: G4497957390, G7732961354, G8414340155

OpenAlex ID: W7084057557

FWCI: 21.19

Cites: 1

Cited by: 18

Related to: