Work

EdgeLLM: Fast On-Device LLM Inference With Speculative Decoding

Year: 2024

Type: article

Source: IEEE Transactions on Mobile Computing

DOI: 10.1109/tmc.2024.3513457

Authors: Daliang Xu, Wangsong Yin, Hao Zhang, Xin Jin, Ying Zhang, Shiyun Wei, Mengwei Xu, Xuanzhe Liu

Institutions: Peking University, Beijing University of Posts and Telecommunications, Beijing Jiaotong University, State Key Laboratory of Networking and Switching Technology

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funder: National Natural Science Foundation of China

Awards: G4497957390, G8414340155

OpenAlex ID: W4405717632

FWCI: 7.365

Cites: 63

Cited by: 50

Related to: 10