Keyword

linear attention

Description: An attention mechanism for neural networks that uses feature transformations to reduce the computational cost of standard softmax attention.
OpenAlex ID: keywords/linear-attention
2023 · Gu, Albert, Dao, Tri · arXiv (Cornell University) · 7,640
2020 · Beltagy, Iz, Peters, Matthew E., et al. · arXiv (Cornell University) · 6,470
2023 · Meng-Hao Guo, Cheng-Ze Lu, et al. · Computational Visual Media · 1,259
2020 · Katharopoulos, Angelos, Vyas, Apoorv, et al. · arXiv (Cornell University) · 1,007
2022 · Jerret Ross, Brian Belgodere, et al. · Nature Machine Intelligence · 749
2022 · Meng-Hao Guo, Zheng-Ning Liu, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 728
2023 · Peng, Bo, Alcaide, Eric, et al. · arXiv (Cornell University) · 722
2023 · Yang, Songlin, Wang, Bailin, et al. · arXiv (Cornell University) · 410
2023 · Dongchen Han, Xuran Pan, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 394
2024 · Xie, Enze, Chen, Junsong, et al. · arXiv (Cornell University) · 297
2024 · Dongchen Han, Tianzhu Ye, et al. · Lecture notes in computer science · 289
2024 · Munkhdalai, Tsendsuren, Faruqui, Manaal, et al. · arXiv (Cornell University) · 259
2024 · Wenfeng Zheng, Siyu Lu, et al. · PeerJ Computer Science · 203
2024 · Dongchen Han, Ziyi Wang, et al. · neural information processing systems · 187
2023 · Zhu, Rui-Jie, Zhao, Qihang, et al. · arXiv (Cornell University) · 183
2021 · Bello, Irwan · arXiv (Cornell University) · 181
2025 · Jia Guo, Shuai Lu, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 177
2024 · Arora, Simran, Eyuboglu, Sabri, et al. · arXiv (Cornell University) · 141
2022 · Zhen Qin, Xiaodong Han, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 105
2024 · Qin, Zhen, Yang, Songlin, et al. · arXiv (Cornell University) · 104
2021 · Ankit Gupta, Guy Dar, et al. · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · 91
2025 · Chen, Junsong, Zhao, Yuyang, et al. · arXiv (Cornell University) · 84
2024 · Qin, Zhen, Sun, Weigao, et al. · arXiv (Cornell University) · 84
Works count: 1,127
Citation count: 27,370
Year
Topic
Type