Keyword

sparse transformer

Description: A sparse transformer is a transformer neural network that limits attention or computation to selected elements, improving efficiency for long sequences or large inputs.
OpenAlex ID: keywords/sparse-transformer
2019 · Child, Rewon, Gray, Scott, et al. · arXiv (Cornell University) · 3,333
2022 · Srivastava, Aarohi, Rastogi, Abhinav, et al. · arXiv (Cornell University) · 2,167
2023 · Xiang Chen, Hao Li, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 847
2022 · Reza Yazdani Aminabadi, Samyam Rajbhandari, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 841
2023 · Srivastava A., Rastogi A., et al. · BOA (University of Milano-Bicocca) · 724
2020 · Tay, Yi, Dehghani, Mostafa, et al. · arXiv (Cornell University) · 720
2022 · Xu, Runsheng, Tu, Zhengzhong, et al. · arXiv (Cornell University) · 471
2022 · Lue Fan, Ziqi Pang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 414
2024 · Shihao Zhou, Duosheng Chen, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 367
2020 · Trevor Gale, Matei Zaharia, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 352
2020 · Sifan Wu, Xi Xiao, et al. · neural information processing systems · 314
2019 · Gonçalo M. Correia, Vlad Niculae, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 307
2022 · Yuanhao Cai, Jing Lin, et al. · Lecture notes in computer science · 255
2023 · Guo, Daya, Xu, Canwen, et al. · arXiv (Cornell University) · 163
2024 · Pin Tang, Zhongdao Wang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 139
2021 · Jaszczur, Sebastian, Chowdhery, Aakanksha, et al. · arXiv (Cornell University) · 122
2022 · Chao Fang, Aojun Zhou, et al. · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · 116
2024 · Jun Wei Chan, Chai Kiat Yeo · The Electricity Journal · 109
2024 · Yansong Peng, Hebei Li, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 106
2022 · Lin, Jing, Cai, Yuanhao, et al. · arXiv (Cornell University) · 101
2024 · Jian Jiang, Lu Ke, et al. · Wiley Interdisciplinary Reviews Computational Molecular Science · 97
2020 · Yun, Chulhee, Chang, Yin-Wen, et al. · arXiv (Cornell University) · 78
2024 · Jie Zhao, Yun Jia, et al. · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 76
2023 · Chengxi Li, Yejing Wang, et al. · ACM Conference on Recommender Systems (RecSys) · 75
Works count: 281
Citation count: 10,290
Year
Topic
Type