Keyword

KV cache compression

Description: Techniques that reduce the memory footprint of transformer key-value caches while retaining information needed for efficient language-model inference.
Primary topic: Topic Modeling (32%)
OpenAlex ID: keywords/kv-cache-compression
2023 · Zichang Liu, Aditya Desai, et al. · neural information processing systems · 605
2024 · Cai, Zefan, Zhang, Yichi, et al. · arXiv (Cornell University) · 568
2024 · Ge, Suyu, Zhang, Yunan, et al. · International Conference on Learning Representations · 484
2024 · Yuhan Liu, Hanchen Li, et al. · ACM SIGCOMM Conference (SIGCOMM) · 452
2024 · Akide Liu, Jing Liu, et al. · neural information processing systems · 249
2026 · DeepSeek-AI, :, et al. · arXiv (Cornell University) · 236
2024 · Dongjie Yang, Xiaodong Han, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 227
2025 · Wu, Wenhao, Wang, Yizhong, et al. · International Conference on Learning Representations · 217
2024 · Yefei He, Luoming Zhang, et al. · neural information processing systems · 143
2024 · Sun, Hanshi, Chen, Zhuoming, et al. · arXiv (Cornell University) · 130
2024 · Alessio Devoto, Yu Zhao, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 130
2024 · Liu, Ting, Shi, Liangtao, et al. · arXiv (Cornell University) · 129
2024 · Wang, Zheng, Jin, Boxiao, et al. · arXiv (Cornell University) · 123
2025 · Zefan Cai, Wen Xiao, et al. · neural information processing systems · 112
2024 · Haoyi Wu, Kewei Tu · Proceedings of the conference - Association for Computational Linguistics. Meeting · 111
2026 · Xu, Ruyi, Xiao, Guangxuan, et al. · International Conference on Learning Representations · 110
2024 · Yin, Wangsong, Xu, Mengwei, et al. · arXiv (Cornell University) · 101
2025 · Chang, Chi-Chih, Lin, Wei-Cheng, et al. · International Conference on Learning Representations · 98
2025 · Xiang Liu, Zhenheng Tang, et al. · neural information processing systems · 98
2025 · Jingbo Yang, Bairu Hou, et al. · neural information processing systems · 97
2025 · Wen Cheng, Shichen Dong, et al. · IEEE International Conference on Computer Vision Workshops · 96
2025 · Wan, Zhongwei, Wu, Xinjian, et al. · International Conference on Learning Representations · 88
2026 · Eyuboglu, Sabri, Ehrlich, Ryan, et al. · International Conference on Learning Representations · 81
2024 · Duanmu, Haojie, Yuan, Zhihang, et al. · arXiv (Cornell University) · 78
2025 · Shan, Lianlei, Luo, Shixian, et al. · arXiv (Cornell University) · 74
Works count: 651
Citation count: 8,255
Year
Topic
Type