Keyword

self-distillation

Description: A machine-learning training technique in which a model uses its own predictions or representations as targets to improve learning or efficiency.
OpenAlex ID: keywords/self-distillation
2021 · Mathilde Caron, Hugo Touvron, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 11,460
2024 · Jianlyu Chen, Shitao Xiao, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 3,185
2025 · Tschannen, Michael, Gritsenko, Alexey, et al. · arXiv (Cornell University) · 1,821
2019 · Linfeng Zhang, Jiebo Song, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 1,420
2020 · Yonglong Tian, Yue Wang, et al. · Lecture notes in computer science · 1,256
2022 · Baevski, Alexei, Hsu, Wei-Ning, et al. · arXiv (Cornell University) · 1,217
2021 · Zhou, Jinghao, Wei, Chen, et al. · arXiv (Cornell University) · 1,141
2024 · Cai, Tianle, Li, Yuhong, et al. · arXiv (Cornell University) · 1,027
2024 · Kunchang Li, Xinhao Li, et al. · Lecture notes in computer science · 788
2024 · Anastassiou, Philip, Chen, Jiawei, et al. · arXiv (Cornell University) · 548
2023 · Zhendong Yang, Ailing Zeng, et al. · IEEE International Conference on Computer Vision Workshops · 518
2020 · Weijie Liu, Peng Zhou, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 506
2024 · Peng, Yansong, Li, Hebei, et al. · arXiv (Cornell University) · 495
2026 · Hübotter, Jonas, Lübeck, Frederike, et al. · arXiv (Cornell University) · 466
2020 · Allen-Zhu, Zeyuan, Li, Yuanzhi · arXiv (Cornell University) · 466
2020 · Sukmin Yun, Jongjin Park, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 421
2021 · Linfeng Zhang, Chenglong Bao, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 386
2021 · Kyungyul Kim, ByeongMoon Ji, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 368
2025 · Zhenyi Shen, Hanqi Yan, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 354
2026 · Shenfeld, Idan, Damani, Mehul, et al. · arXiv (Cornell University) · 338
2021 · Horvath, Samuel, Laskaridis, Stefanos, et al. · arXiv (Cornell University) · 332
2020 · Mobahi, Hossein, Farajtabar, Mehrdad, et al. · arXiv (Cornell University) · 307
2022 · Yuansong Zeng, Zhuoyi Wei, et al. · Briefings in Bioinformatics · 289
2023 · Hui Ma, Jian Wang, et al. · IEEE Transactions on Multimedia · 262
2024 · Xiaojun Hou, Jiazheng Xing, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 243
Works count: 2,438
Citation count: 57,440
Year
Topic
Type