Work

QMLFQ: A Quantization-based Queue Scheduling Framework for Efficient LLM Serving

Year: 2024

Type: conference-paper

Source: IEEE Smart World Congress (SWC)

DOI: 10.1109/swc62898.2024.00208

Authors: Jiali Wu, Hao Dai, Jiashu Wu, Wenming Jin, Yang Wang

Institutions: Chinese Academy of Sciences, Shenzhen Institutes of Advanced Technology, China Telecom, University of Southampton

Language: English

Topic: Cloud Computing and Resource Management

Subfield: Information Systems

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funder: Research and Development

OpenAlex ID: W4408795303

FWCI:

Cites: 20

Cited by:

Related to: 10