Keyword

TinyBERT

Description: TinyBERT is a compact transformer language model derived from BERT through knowledge distillation for efficient natural language processing.
Primary topic: Topic Modeling (21%)
OpenAlex ID: keywords/tinybert
2020 · Xiaoqi Jiao, Yichun Yin, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 3,170
2021 · Jieren Deng, Yijue Wang, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 130
2021 · Panjie Qi, Edwin Hsing-Mean Sha, et al. · International Conference on Computer Aided Design · 82
2020 · Lee, Younghoo, Saxe, Joshua, et al. · arXiv (Cornell University) · 64
2025 · Eileen Paula, Jayesh Soni, et al. · Scientific Reports · 54
2023 · Latif, Ehsan, Fang, Luyang, et al. · arXiv (Cornell University) · 50
2021 · Xuanang Chen, Ben He, et al. · Lecture notes in computer science · 47
2022 · Xiaoxia Wu, Zhewei Yao, et al. · neural information processing systems · 35
2023 · Daojing He, Xin Lv, et al. · IEEE Internet of Things Journal · 34
2024 · Souvika Sarkar, Mohammad Fakhruddin Babar, et al. · ACM/SPEC International Conference on Performance Engineering (ICPE) · 30
2020 · Zhang, Yang, Deng, Liqun, et al. · arXiv (Cornell University) · 30
2024 · Ehsan Latif, Luyang Fang, et al. · Communications in computer and information science · 28
2023 · Helong Yu, Chunliu Liu, et al. · Computers in Biology and Medicine · 28
2024 · Yazdan Zandiye Vakili, Avisa Fallah, et al. · International Conference on Computer and Knowledge Engineering · 25
2024 · Dashun Zheng, Jiaxuan Li, et al. · Applied Sciences · 24
2023 · Yasaman Boreshban, Seyed Morteza Mirbostani, et al. · Engineering Applications of Artificial Intelligence · 23
2022 · Yifei Luo, Minghui Xu, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 22
2025 · Dingzong Zhang, Devi Listiyani, et al. · IEEE Access · 20
2025 · Aijazahamed Qazi, R. H. Goudar, et al. · IEEE Access · 17
2024 · Mohammad Junayed Hasan, Fuad Rahman, et al. · International Journal of Medical Informatics · 16
2022 · Syed Mustavi Maheen, Moshiur Rahman Faisal, et al. · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · 16
2026 · Hai An Vu, Minh-Phuc Truong, et al. · Knowledge-Based Systems · 15
Works count: 222
Citation count: 4,399
Year
Topic
Type