Keyword

multilingual pre-training

Description: Multilingual pre-training is the process of training a language model on data from multiple languages before adapting it to particular tasks.
Primary topic: Topic Modeling (43%)
OpenAlex ID: keywords/multilingual-pretraining
2021 · Fedus, William, Zoph, Barret, et al. · arXiv (Cornell University) · 2,802
2020 · Yinhan Liu, Jiatao Gu, et al. · Transactions of the Association for Computational Linguistics · 2,601
2022 · Arun Babu, Changhan Wang, et al. · Interspeech (USB) · 1,381
2023 · Yang, Aiyuan, Xiao, Bin, et al. · arXiv (Cornell University) · 1,336
2020 · Tang, Yuqing, Tran, Chau, et al. · arXiv (Cornell University) · 715
2022 · Francesco Barbieri, Luis Espinosa Anke, et al. · Language Resources and Evaluation Conference (LREC) · 598
2020 · Edoardo Maria Ponti, Goran Glavaš, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 570
2021 · Zewen Chi, Li Dong, et al. · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 516
2023 · Zhang, Yu, Han, Wei, et al. · arXiv (Cornell University) · 506
2022 · Zhiyu Li, Shuai Lu, et al. · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · 423
2021 · Kelechi Ogueji, Yuxin Zhu, et al. · Workshop on Multilingual Representation Learning (MRL) · 352
2024 · Oleh Shliazhko, Alena Fenogenova, et al. · Transactions of the Association for Computational Linguistics · 277
2022 · Jiapeng Wang, Lianwen Jin, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 242
2023 · Chung, Hyung Won, Constant, Noah, et al. · arXiv (Cornell University) · 220
2022 · Jiaxi Gu, Xiaojun Meng, et al. · neural information processing systems · 208
2024 · Tyler A. Chang, Catherine Arnett, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 186
2021 · Ilias Chalkidis, Manos Fergadiotis, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 184
2021 · Mroczkowski, Robert, Rybak, Piotr, et al. · arXiv (Cornell University) · 146
2021 · Minheng Ni, Haoyang Huang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 144
2020 · Philipp Dufter, Hinrich Schütze · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 139
2020 · Jui-Yang Hsu, Yuan-Jui Chen, et al. · IEEE International Conference on Acoustics Speech and Signal Processing · 133
2022 · Zewen Chi, Shaohan Huang, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 123
2022 · Tahir Javed, Sumanth Doddapaneni, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 108
2020 · Jiatao Gu, Yinhan Liu, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 103
2022 · Ming Zhu, Karthik Suresh, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 89
Works count: 613
Citation count: 17,300
Year
Topic
Type