Keyword

attention layers

Description: Attention layers are components of neural network architectures that compute weighted relationships between input elements, especially in deep learning and language models.
OpenAlex ID: keywords/attention-layers
2018 · Kool, Wouter, van Hoof, Herke, et al. · UvA-DARE (University of Amsterdam) · 1,826
2021 · Hila Chefer, Shir Gur, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,635
2024 · Mingtian Tan, Mike Merrill, et al. · neural information processing systems · 507
2021 · Nicolo Bonettini, Edoardo Daniele Cannas, et al. · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · 386
2023 · Kwangjun Ahn, Xiang Cheng, et al. · neural information processing systems · 341
2023 · Jiehui Huang, Jun Zhou, et al. · Knowledge-Based Systems · 197
2018 · Vishvak S. Murahari, Thomas Plötz · ACM International Symposium on Wearable Computers (ISWC) · 193
2024 · Selvaraju, Pratheba, Ding, Tianyu, et al. · arXiv (Cornell University) · 185
2018 · Daniel Povey, Hossein Hadian, et al. · IEEE International Conference on Acoustics Speech and Signal Processing · 183
2023 · Clayton Sanford, Daniel Hsu, et al. · neural information processing systems · 175
2023 · Hung-Yu Tseng, Qinbo Li, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 165
2020 · Siddhant M. Jayakumar, Jacob Menick, et al. · International Conference on Learning Representations · 161
2019 · Lu Yu, Vacit Oguz Yazici, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 149
2018 · Biao Zhang, Deyi Xiong, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 147
2022 · Fengbin Tu, Zihan Wu, et al. · IEEE Journal of Solid-State Circuits · 113
2024 · Zeping Yu, Sophia Ananiadou · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 110
2020 · Maria Mihaela Truşcǎ, Daan Wassenberg, et al. · Lecture notes in computer science · 79
2025 · Ziheng Ouyang, Zhen Li, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 78
2025 · Helbling, Alec, Meral, Tuna Han Salih, et al. · arXiv (Cornell University) · 64
2026 · Dominic Maggio, Luca Carlone · Robotics: Science and Systems · 58
2024 · Tianyi Zhou, Deqing Fu, et al. · neural information processing systems · 55
2023 · Zhengdong Hu, Yifan Sun, et al. · neural information processing systems · 53
2021 · Kristian Miok, Blaž Škrlj, et al. · Cognitive Computation · 53
2020 · Bojian Zheng, Nandita Vijaykumar, et al. · Proceedings - International Symposium on Computer Architecture/Proceedings · 52
2024 · Xianming Li, Jing Li · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 51
Works count: 300
Citation count: 8,747
Year
Topic
Type