Keyword

key-value cache compression

Description: Techniques for reducing the memory or storage needed for attention key-value caches during large language model inference.
Primary topic: Topic Modeling (34%)
OpenAlex ID: keywords/key-value-cache-compression
2024 · DeepSeek-AI, Liu, Aixin, et al. · arXiv (Cornell University) · 1,976
2024 · Yuhong Li, Yingbing Huang, et al. · neural information processing systems · 1,299
2024 · Wu, Zhiyu, Chen, Xiaokang, et al. · arXiv (Cornell University) · 987
2024 · Kang, Hao, Zhang, Qingru, et al. · arXiv (Cornell University) · 237
2024 · Matanel Oren, Michael Hassid, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 206
2024 · Zhongwei Wan, Ziang Wu, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 152
2024 · Yang, June Yong, Kim, Byeongwook, et al. · arXiv (Cornell University) · 145
2024 · Sun, Xingwu, Chen, Yanfeng, et al. · arXiv (Cornell University) · 141
2024 · Nawrot, Piotr, Łańcucki, Adrian, et al. · arXiv (Cornell University) · 118
2025 · Guangda Liu, Chengwei Li, et al. · ACM/IEEE Design Automation Conference (DAC) · 99
2024 · Utkarsh Saxena, Gobinda Saha, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 99
2024 · Dong, Harry, Yang, Xinyu, et al. · arXiv (Cornell University) · 77
2025 · Yang, Yanlai, Zhao, Zhuokai, et al. · arXiv (Cornell University) · 76
2026 · Zhenyu Ning, Guangda Liu, et al. · ACM/IEEE Design Automation Conference (DAC) · 69
2025 · Chaofan Lin, Jiaming Tang, et al. · neural information processing systems · 64
2024 · He, Yefei, Chen, Feng, et al. · arXiv (Cornell University) · 64
2024 · Yang, Yifei, Cao, Zouying, et al. · arXiv (Cornell University) · 57
2025 · Yanqi Zhang, Yuwei Hu, et al. · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · 56
2024 · Giulio Corallo, Paolo Papotti · Transactions of the Association for Computational Linguistics · 30
2025 · Jialong Wu, Zhenglin Wang, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 29
2026 · Ji, Yicheng, Zhong, Zhizhou, et al. · arXiv (Cornell University) · 27
2026 · Kim, Jang-Hyun, Han, Dongyoon, et al. · arXiv (Cornell University) · 25
2024 · Wang, Zihao, Cui, Bin, et al. · arXiv (Cornell University) · 24
2025 · Yanyu Liu, Jingying Fu, et al. · International Conference on Artificial Intelligence and Intelligent Information Processing (AIIIP) · 22
Works count: 208
Citation count: 6,710
Year
Topic
Type