Work

Official Implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"

Year: 2024

Type: software

Abstract: This artifact is the official open-source implementation for ASPLOS 2025 paper "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow". It contains the simulator and the prototype system used in this paper. A detailed step-by-step guide to environment setup and example usage is in the readme file.

Source: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.14037926

Authors: Mei, Yixuan, Zhuang, Yonghao, Miao, Xupeng, Yang, Juncheng, Jia, Zhihao, Vinayak, Rashmi

Institution: Carnegie Mellon University

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W7223744381

Cites:

Cited by:

Related to: 10