Work

Subkv: Quantizing Long Context KV Cache for Sub‐Billion Parameter Language Models on Edge Devices

Year: 2025

Type: article

Source: Software Practice and Experience

DOI: 10.1002/spe.3422

Authors: Ziqian Zeng, Tao Zhang, Zhengdong Lu, Wenjun Li, Huiping Zhuang, Hongen Shao, Sin G. Teo, Xiaofeng Zou

Institutions: South China University of Technology, Agency for Science, Technology and Research, Institute for Infocomm Research

Language: English

Topic: Advanced Neural Network Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funders: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Fundamental Research Funds for the Central Universities, Basic and Applied Basic Research Foundation of Guangdong Province

Awards: G2287814283, G4421831070, G5208094796, G645884509, G7626417556

OpenAlex ID: W4409108393

FWCI: 0.719

Cites: 40

Cited by: 2

Related to: 10