Keyword

self-attention complexity

Description: The computational and memory costs associated with self-attention operations in neural networks, especially transformer models.
OpenAlex ID: keywords/self-attention-complexity
2018 · Lee, Juho, Lee, Yoonho, et al. · Oxford University Research Archive (ORA) (University of Oxford) · 836
2020 · Tay, Yi, Dehghani, Mostafa, et al. · arXiv (Cornell University) · 725
2024 · Abdelrahman Shaker, Muhammad Maaz, et al. · IEEE Transactions on Medical Imaging · 689
2023 · Yuning Cui, Alois Knoll · Neural Networks · 167
2024 · Yuntao Shou, Huan Liu, et al. · IEEE Transactions on Affective Computing · 110
2021 · Junyan Cheng, Iordanis Fostiropoulos, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 93
2023 · Charles Condevaux, Sébastien Harispe · Lecture notes in computer science · 66
2023 · Wenhui Peng, Zelong Yuan, et al. · Physics of Fluids · 58
2025 · Jeddi, Ahmadreza, Baghbanzadeh, Negin, et al. · arXiv (Cornell University) · 50
2018 · Juho Lee, Yoonho Lee, et al. · arXiv (Cornell University) · 32
2024 · Mudvari, Akrit, Jiang, Yuang, et al. · arXiv (Cornell University) · 29
2024 · Guoxiang Tong, Zhaoyuan Ge, et al. · Applied Intelligence · 29
2024 · Rajat Koner, Gagan Jain, et al. · Lecture notes in computer science · 28
2021 · Minghan Li, Eric Gaussier · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · 28
2025 · Qian Dong, Qingyao Ai, et al. · International World Wide Web Conference (WWW) · 25
2024 · Zhenyu Bai, Pranav Dangi, et al. · ACM/IEEE Design Automation Conference (DAC) · 25
2024 · Seungjae Yoo, Hangyeol Kim, et al. · IEEE/ACM International Symposium on Microarchitecture (MICRO) · 18
2024 · Qiang, Yupeng, Dong, Xunde, et al. · arXiv (Cornell University) · 18
2025 · Shuning Chang, Pichao WANG, et al. · neural information processing systems · 17
2023 · Shirkavand, Reza, Huang, Heng · arXiv (Cornell University) · 17
2022 · Jeevan, Pranav, sethi, Amit · arXiv (Cornell University) · 17
2026 · Yundong Sun, Dongjie Zhu, et al. · Information Sciences · 16
2025 · Xiao Wang, Jong-Youl Choi, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 16
2025 · Zeqiang Wei, Kai Jin, et al. · IEEE Transactions on Computational Imaging · 16
2025 · Xiong, Minhao, Wen, Zichen, et al. · arXiv (Cornell University) · 15
Works count: 130
Citation count: 3,448
Year
Topic
Type