Keyword

knowledge distillation

Description: A machine-learning method that transfers information from a trained model, often a larger one, to another model, often smaller or more efficient.
Wikidata ID: wiki/Q74253442
OpenAlex ID: keywords/knowledge-distillation
2015 · Hinton, Geoffrey, Vinyals, Oriol, et al. · arXiv (Cornell University) · 26,325
2025 · Yang, An, Li, Anfeng, et al. · arXiv (Cornell University) · 17,885
2019 · Sanh, Victor, Debut, Lysandre, et al. · arXiv (Cornell University) · 10,350
2023 · Oquab, Maxime, Darcet, Timothée, et al. · arXiv (Cornell University) · 7,834
2021 · Jianping Gou, Baosheng Yu, et al. · International Journal of Computer Vision · 4,385
2014 · Romero, Adriana, Ballas, Nicolas, et al. · arXiv (Cornell University) · 4,025
2024 · Gemma Team, Riviere, Morgane, et al. · arXiv (Cornell University) · 3,255
2016 · Nicolas Papernot, Patrick McDaniel, et al. · IEEE Symposium on Security and Privacy (S&P) · 3,255
2020 · Xiaoqi Jiao, Yichun Yin, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 2,435
2019 · Wonpyo Park, Dongju Kim, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,913
2017 · Junho Yim, Donggyu Joo, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,677
2020 · Chen, Ting, Kornblith, Simon, et al. · arXiv (Cornell University) · 1,668
2024 · Abdin, Marah, Aneja, Jyoti, et al. · arXiv (Cornell University) · 1,611
2024 · Chong Mou, Xintao Wang, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 1,492
2024 · Jingyi Zhang, Jiaxing Huang, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 1,301
2017 · Cheng, Yu, Wang, Duo, et al. · arXiv (Cornell University) · 1,293
2019 · Fred Tung, Greg Mori · IEEE/CVF International Conference on Computer Vision (ICCV) · 1,227
2019 · Zheng Hui, Xinbo Gao, et al. · ACM International Conference on Multimedia (ACM MM) · 1,224
2018 · Francisco M. Castro, Manuel J. Marín-Jiménez, et al. · Lecture notes in computer science · 1,206
2016 · Yoon Kim, Alexander M. Rush · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 1,195
2020 · Nils Reimers, Iryna Gurevych · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 1,190
2019 · Müller, Rafael, Kornblith, Simon, et al. · arXiv (Cornell University) · 1,189
2020 · Mirzadeh, Seyed Iman, Farajtabar, Mehrdad, et al. · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 1,186
2019 · Tian, Yonglong, Krishnan, Dilip, et al. · arXiv (Cornell University) · 1,121
Works count: 28,660
Citation count: 437,300
Year
Topic
Type