Description: A memory structure that stores key-value pairs for rapid retrieval, including attention states used during large language model inference.
2024 · Adilbek Karmanov, Dayan Guan, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 116
2025 · Yufeng Gu, Alireza Khadem, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 75