Keyword

SciBERT

Description: A pretrained language model based on the Transformer architecture, designed to represent and process scientific text for natural language processing tasks.
Primary topic: Topic Modeling (32%)
OpenAlex ID: keywords/scibert
2019 · Iz Beltagy, Kyle Lo, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 4,473
2022 · Tanishq Gupta, Mohd Zaki, et al. · npj Computational Materials · 533
2019 · Beltagy, Iz, Lo, Kyle, et al. · arXiv (Cornell University) · 378
2022 · Tanik Saikh, Tirthankar Ghosal, et al. · International Journal on Digital Libraries · 260
2019 · Iz Beltagy, Arman Cohan, et al. · 195
2022 · Shu Huang, Jacqueline M. Cole · Journal of Chemical Information and Modeling · 187
2020 · Yun He, Ziwei Zhu, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 152
2023 · Zhengliang Liu, Xinyu He, et al. · Communications in computer and information science · 93
2020 · Dhruva Sahrawat, Debanjan Mahata, et al. · Lecture notes in computer science · 86
2020 · Ashwin Karthik Ambalavanan, Murthy V. Devarakonda · Journal of Biomedical Informatics · 76
2019 · Hebatallah A. Mohamed Hassan, Giuseppe Sansonetti, et al. · Iris (Roma Tre University) · 76
2025 · Hoang Cuong Nguyen, Shahroz Tariq, et al. · International World Wide Web Conference (WWW) · 62
2022 · Nianlong Gu, Yingqiang Gao, et al. · Lecture notes in computer science · 58
2025 · Liangping Ding, Cornelia Lawson, et al. · Scientometrics · 53
2022 · Xiaoyan Cai, Sen Liu, et al. · Journal of Biomedical Informatics · 52
2020 · Kommaraju, Vaishnavi, Gunasekaran, Karthick, et al. · arXiv (Cornell University) · 51
2020 · Malte Ostendorff, Terry Ruas, et al. · International Conference on Computational Linguistics · 48
2021 · Nicholas Walker, Amalie Trewartha, et al. · SSRN Electronic Journal · 47
2020 · Xing David Wang, Leon Weber, et al. · International Workshop on Health Text Mining and Information Analysis (LOUHI) · 47
2025 · Zhyar Rzgar K. Rostam, Gábor Kertész · ACM Transactions on Intelligent Systems and Technology · 41
2021 · Dustin Wright, Isabelle Augenstein · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 41
Works count: 576
Citation count: 9,752
Year
Topic
Type