Work

K lotski : Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline

Year: 2025

Type: conference-paper

Source: ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)

DOI: 10.1145/3676641.3716261

Authors: Zhiyuan Fang, Yuegui Huang, Zicong Hong, Yufeng Lyu, Wuhui Chen, Yue Yu, Fan Yu, Zibin Zheng

Institutions: Sun Yat-sen University, Hong Kong University of Science and Technology, Huawei Technologies (China), Peng Cheng Laboratory

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funder: Universitas Brawijaya

Award: G6949136529

OpenAlex ID: W4408894550

FWCI: 5.391

Cites: 15

Cited by: 6

Related to: 10