Keyword

sparse attention

Description: A neural-network attention mechanism that restricts which tokens or features interact, reducing computation compared with fully connected attention.
OpenAlex ID: keywords/sparse-attention
2020 · Zaheer, Manzil, Guruganesh, Guru, et al. · arXiv (Cornell University) · 3,754
2025 · DeepSeek-AI, Liu, Aixin, et al. · arXiv (Cornell University) · 1,808
2023 · Lei Zhu, Xinjiang Wang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,652
2022 · Zhuofan Xia, Xuran Pan, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,436
2021 · Rao, Yongming, Zhao, Wenliang, et al. · arXiv (Cornell University) · 1,397
2021 · Aurko Roy, Mohammad Saffar, et al. · Transactions of the Association for Computational Linguistics · 923
2021 · Hanrui Wang, Zhekai Zhang, et al. · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · 674
2025 · Jingyang Yuan, Huazuo Gao, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 668
2025 · Yuzhang Shang, Mu Cai, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 640
2024 · Huiqiang Jiang, Yucheng Li, et al. · neural information processing systems · 510
2022 · Kevin Lin, Linjie Li, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 455
2025 · Yang, An, Yu, Bowen, et al. · arXiv (Cornell University) · 415
2021 · Wu, Chenfei, Huang, Lun, et al. · arXiv (Cornell University) · 365
2022 · Mingjin Zhang, Haichen Bai, et al. · ACM International Conference on Multimedia (ACM MM) · 300
2025 · Enzhe Lu, Zhejun Jiang, et al. · neural information processing systems · 298
2021 · Liqiang Lu, Yicheng Jin, et al. · IEEE/ACM International Symposium on Microarchitecture (MICRO) · 295
2022 · Haochen Wang, Jiayi Shen, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 266
2023 · Shirzad, Hamed, Velingker, Ameya, et al. · arXiv (Cornell University) · 264
2021 · Kalpesh Krishna, Aurko Roy, et al. · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 263
2025 · Zhang, Jintao, Xiang, Chendong, et al. · arXiv (Cornell University) · 255
2025 · Xi, Haocheng, Yang, Shuo, et al. · arXiv (Cornell University) · 255
2021 · Brendan Duke, Abdalla Ahmed, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 247
2024 · Ye, Tianzhu, Dong, Li, et al. · arXiv (Cornell University) · 246
2020 · Tay, Yi, Bahri, Dara, et al. · arXiv (Cornell University) · 237
2022 · Zhihong Fu, Zehua Fu, et al. · International Joint Conference on Artificial Intelligence · 228
Works count: 2,139
Citation count: 35,820
Year
Topic
Type