Keyword

key-value cache

Description: A memory structure that stores key-value pairs for rapid retrieval, including attention states used during large language model inference.
Primary topic: Topic Modeling (23%)
OpenAlex ID: keywords/key-value-cache
2023 · Woosuk Kwon, Zhuohan Li, et al. · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · 3,968
2022 · Renrui Zhang, Wei Zhang, et al. · Lecture notes in computer science · 522
2025 · Wu, Chengyue, Zhang, Hao, et al. · arXiv (Cornell University) · 333
2021 · Yangyang Shi, Yongqiang Wang, et al. · IEEE International Conference on Acoustics Speech and Signal Processing · 152
2025 · Xinyin Ma, Runpeng Yu, et al. · neural information processing systems · 137
2024 · Sun, Hanshi, Chang, Li-Wen, et al. · arXiv (Cornell University) · 116
2024 · Adilbek Karmanov, Dayan Guan, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 116
2025 · Zefan Cai, Wen Xiao, et al. · neural information processing systems · 109
2024 · William Brandon, Mayank Mishra, et al. · neural information processing systems · 106
2024 · Lu Ye, Ze Tao, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 103
2024 · Sun, Hanshi, Chen, Zhuoming, et al. · arXiv (Cornell University) · 89
2024 · Yue, Yuxuan, Yuan, Zhihang, et al. · arXiv (Cornell University) · 89
2025 · Hailin Zhang, Xiaodong Ji, et al. · Proceedings of the ACM on Management of Data · 85
2025 · Wen Cheng, Shichen Dong, et al. · IEEE International Conference on Computer Vision Workshops · 81
2024 · Juravsky, Jordan, Brown, Bradley, et al. · arXiv (Cornell University) · 80
2025 · Zuo, Pengfei, Lin, Huimin, et al. · arXiv (Cornell University) · 78
2025 · Yufeng Gu, Alireza Khadem, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 75
2024 · Alessio Devoto, Yu Zhao, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 74
2013 · Yuehai Xu, Eitan Frachtenberg, et al. · IEEE Internet Computing · 60
2025 · Linke Song, Zixuan Pang, et al. · IEEE Transactions on Information Forensics and Security · 57
2024 · Yang, Shuo, Sheng, Ying, et al. · arXiv (Cornell University) · 56
2024 · Haoyi Wu, Kewei Tu · Proceedings of the conference - Association for Computational Linguistics. Meeting · 55
2017 · Asaf Cidon, Daniel Rushton, et al. · USENIX Annual Technical Conference · 51
2016 · Xingbo Wu, Li Zhang, et al. · European Conference on Computer Systems · 38
2026 · Yaoqi Chen, Jinkai Zhang, et al. · Proceedings of the VLDB Endowment · 35
Works count: 681
Citation count: 9,210
Year
Topic
Type