Keyword

pre-training tasks

Description: Tasks used to train a model before downstream use, often designed to help it learn transferable representations from data.
Primary topic: Topic Modeling (35%)
OpenAlex ID: keywords/pre-training-tasks
2019 · Tan, Hao, Bansal, Mohit · arXiv (Cornell University) · 1,251
2020 · Zhuang Liu, Degen Huang, et al. · International Joint Conference on Artificial Intelligence · 554
2022 · Yifan Du, Zikang Liu, et al. · International Joint Conference on Artificial Intelligence · 381
2020 · Chang, Wei-Cheng, Yu, Felix X., et al. · arXiv (Cornell University) · 351
2021 · Chi Ian Tang, Ignacio Perez-Pozuelo, et al. · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 202
2021 · Pei Ke, Haozhe Ji, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 163
2024 · Liu, Yiheng, He, Hao, et al. · arXiv (Cornell University) · 135
2024 · Yiheng Liu, Hao He, et al. · Neurocomputing · 106
2022 · Yuxiang Wu, Yu Zhao, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 85
2020 · Hrituraj Singh, Sumit Shekhar · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 83
2022 · Barlas Oguz, Kushal Lakhotia, et al. · Findings of the Association for Computational Linguistics: NAACL · 65
2024 · Lipeng Ma, Weidong Yang, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 59
2023 · Jiexin Wang, Adam Jatowt, et al. · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · 57
2020 · Chaojun Xiao, Yuan Yao, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 56
2024 · Tianyu He, Darshil Doshi, et al. · neural information processing systems · 55
2023 · Zaijing Li, Ting-En Lin, et al. · ACM International Conference on Multimedia (ACM MM) · 55
2025 · Jiaming Han, Hao Chen, et al. · neural information processing systems · 52
2024 · Yiheng Liu, Hao He, et al. · SSRN Electronic Journal · 51
2022 · Man Luo, Arindam Mitra, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 50
2025 · Xu-Yang Chen, Lu Han, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 40
2020 · Stéphane Aroca-Ouellette, Frank Rudzicz · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 40
2024 · Siying Wu, Xueyang Fu, et al. · IEEE Transactions on Multimedia · 38
2023 · Wenhu Chen, Pat Verga, et al. · Conference of the European Chapter of the Association for Computational Linguistics · 37
2024 · Khan, Asifullah, Sohail, Anabia, et al. · arXiv (Cornell University) · 34
2022 · Yiming Qiu, Chenyu Zhao, et al. · ACM International Conference on Information and Knowledge Management (CIKM) · 34
Works count: 119
Citation count: 4,633
Year
Topic
Type