Keyword

DistilBERT

Description: A compact transformer-based language model derived from BERT for natural language processing tasks.
Wikidata ID: wiki/Q107032059
OpenAlex ID: keywords/distilbert
2019 · Sanh, Victor, Debut, Lysandre, et al. · arXiv (Cornell University) · 13,541
2020 · Yuliang Li, Jinfeng Li, et al. · Proceedings of the VLDB Endowment · 670
2023 · Kumar, Aounon, Agarwal, Chirag, et al. · arXiv (Cornell University) · 402
2020 · Acheampong Francisca Adoma, Nunoo-Mensah Henry, et al. · International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP) · 342
2023 · Amira Samy Talaat · Journal Of Big Data · 324
2022 · Woosuk Kwon, Sehoon Kim, et al. · neural information processing systems · 267
2023 · Aaron Nicolson, Jason Dowling, et al. · Artificial Intelligence in Medicine · 260
2021 · Jackie Ayoub, X. Jessie Yang, et al. · Information Processing & Management · 190
2020 · Brunner, Ursin, Stockinger, Kurt · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · 181
2021 · Varun Dogra, Aman Singh, et al. · Lecture notes in networks and systems · 145
2020 · Mengjie Zhao, Tao Lin, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 126
2021 · Jafar A. Alzubi, Rachna Jain, et al. · Arabian Journal for Science and Engineering · 123
2022 · Mohsinul Kabir, Tasnim Ahmed, et al. · Computers in Human Behavior · 122
2024 · Hadis Bashiri, Hassan Naderi · Knowledge and Information Systems · 117
2021 · Jordan J. Bird, Anikó Ekárt, et al. · Journal of Ambient Intelligence and Humanized Computing · 117
2023 · Chih-Hsueh Lin, Ulin Nuha · Journal Of Big Data · 108
2024 · Marios Kerasiotis, Loukas Ilias, et al. · Social Network Analysis and Mining · 103
2020 · Hassan Sajjad, Fahim Dalvi, et al. · arXiv (Cornell University) · 102
2021 · Zafrir, Ofir, Larey, Ariel, et al. · arXiv (Cornell University) · 101
2023 · Yujia Zhai, Chengquan Jiang, et al. · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · 99
2024 · Yichao Wu, Zhengyu Jin, et al. · Applied and Computational Engineering · 97
2025 · Ravi Varma Kumar Bevara, Nishith Reddy Mannuru, et al. · Electronics · 90
Works count: 3,173
Citation count: 31,260
Year
Topic
Type