Keyword

KV cache quantization

Description: Techniques that represent transformer key-value cache entries with reduced numerical precision to save memory during language-model inference.
OpenAlex ID: keywords/kv-cache-quantization
2024 · Saleh Ashkboos, Amirkeivan Mohtashami, et al. · neural information processing systems · 931
2024 · Coleman Hooper, Sehoon Kim, et al. · neural information processing systems · 906
2025 · Liu, Zechun, Zhao, Changsheng, et al. · International Conference on Learning Representations · 473
2023 · Liu, Zechun, Oguz, Barlas, et al. · arXiv (Cornell University) · 423
2024 · Lin, Yujun, Tang, Haotian, et al. · arXiv (Cornell University) · 233
2024 · Li, Shiyao, Ning, Xuefei, et al. · arXiv (Cornell University) · 183
2024 · Yefei He, Luoming Zhang, et al. · neural information processing systems · 143
2026 · Zandieh, Amir, Daliri, Majid, et al. · International Conference on Learning Representations · 129
2025 · Liu, Ruikang, Sun, Yuxuan, et al. · arXiv (Cornell University) · 122
2025 · Wen Cheng, Shichen Dong, et al. · IEEE International Conference on Computer Vision Workshops · 96
2025 · Zunhai Su, Hanyu Wei, et al. · International Joint Conference on Artificial Intelligence · 74
2025 · Amir Zandieh, Majid Daliri, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 74
2025 · Xu, Yuhui, Jie, Zhanming, et al. · International Conference on Learning Representations · 69
2026 · Chen, Yukang, Wang, Luozhou, et al. · arXiv (Cornell University) · 45
2023 · Zirui Liu, Jiayi Yuan, et al. · arXiv (Cornell University) · 44
2024 · Jiayi Yuan, Hongyi Liu, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 40
2025 · Tiwari, Rishabh, Xi, Haocheng, et al. · arXiv (Cornell University) · 38
2025 · Han, Insu, Kacham, Praneeth, et al. · arXiv (Cornell University) · 37
2025 · Yi Su, Yuechi Zhou, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 36
2026 · Xi, Haocheng, Yang, Shuo, et al. · arXiv (Cornell University) · 34
2026 · Zhang, Shihao, Zhang, Haoyu, et al. · International Conference on Learning Representations · 25
2026 · Liu, Tengxuan, Li, Shiyao, et al. · International Conference on Learning Representations · 23
2026 · Dayou Du, Shijie Cao, et al. · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · 22
2025 · Savkin, Semyon, Porat, Eitan, et al. · arXiv (Cornell University) · 22
Works count: 200
Citation count: 5,751
Year
Topic
Type