Keyword

BERT pre-training

Description: The initial training of a BERT language model on large-scale data to learn contextual representations before adapting it to specific tasks.
Primary topic: Topic Modeling (38%)
OpenAlex ID: keywords/bert-pre-training
2020 · Mandar Joshi, Danqi Chen, et al. · Transactions of the Association for Computational Linguistics · 2,546
2019 · Baevski, Alexei, Schneider, Steffen, et al. · arXiv (Cornell University) · 602
2020 · Zeping Yu, Rui Cao, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 315
2023 · Xiaoyi Dong, Jianmin Bao, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 220
2020 · Xiangyang Li, Huan Zhang, et al. · Journal of Biomedical Informatics · 210
2021 · Timo Spinde, Manuel Plank, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 153
2021 · Krell, Mario Michael, Kosec, Matej, et al. · arXiv (Cornell University) · 145
2023 · Dong, Xiaoyi, Bao, Jianmin, et al. · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 141
2021 · Shen, Jia Tracy, Yamashita, Michiharu, et al. · arXiv (Cornell University) · 123
2019 · Gao Peng, Haoxuan You, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 106
2023 · Weichao Zhao, Hezhen Hu, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 100
2021 · Tang, Hanlin, Gan, Shaoduo, et al. · arXiv (Cornell University) · 91
2020 · Chen Jia, Yuefeng Shi, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 83
2019 · Yang You, Jing Li, et al. · arXiv (Cornell University) · 80
2021 · Qianqian Dong, Rong Ye, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 77
2022 · Cui, Yiming, Yang, Ziqing, et al. · arXiv (Cornell University) · 74
2022 · Yixuan Su, Fangyu Liu, et al. · Findings of the Association for Computational Linguistics: NAACL · 72
2023 · Yang Luo, Xiaozhe Ren, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 65
2024 · Kamel Gaanoun, Abdou Mohamed Naira, et al. · International Journal of Data Science and Analytics · 64
2022 · Baoshen Guo, Weijian Zuo, et al. · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 63
2022 · Yuying Ge, Yixiao Ge, et al. · Lecture notes in computer science · 57
2022 · Nayak, Ravindra, Joshi, Raviraj · arXiv (Cornell University) · 55
2021 · Masahiro Tanaka, Kenjiro Taura, et al. · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · 44
2019 · Peter Shaw, Philip Massey, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 42
2020 · Alireza Mohammadshahi, James Henderson · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 40
Works count: 153
Citation count: 6,518
Year
Topic
Type