Keyword

self-supervised pre-training

Description: A machine learning stage that initializes a model by learning from automatically generated supervisory signals in unlabeled data before task-specific training.
OpenAlex ID: keywords/self-supervised-pretraining
2023 · Oquab, Maxime, Darcet, Timothée, et al. · arXiv (Cornell University) · 11,329
2022 · Sanyuan Chen, Chengyi Wang, et al. · IEEE Journal of Selected Topics in Signal Processing · 4,348
2022 · Ze Liu, Han Hu, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 4,067
2020 · Chen, Ting, Kornblith, Simon, et al. · arXiv (Cornell University) · 2,496
2023 · Christina V. Theodoris, Ling Xiao, et al. · Nature · 1,716
2020 · Chithrananda, Seyone, Grand, Gabriel, et al. · arXiv (Cornell University) · 1,531
2022 · Yucheng Tang, Dong Yang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,307
2022 · Yang Zou, Jongheon Jeong, et al. · Lecture notes in computer science · 1,224
2019 · Roshan Rao, Nicholas Bhattacharya, et al. · bioRxiv (Cold Spring Harbor Laboratory) · 1,180
2021 · Zhou, Jinghao, Wei, Chen, et al. · arXiv (Cornell University) · 1,141
2020 · Jiezhong Qiu, Qibin Chen, et al. · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 1,121
2023 · Limin Wang, Bingkun Huang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 1,110
2022 · Chen Wei, Haoqi Fan, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 992
2022 · Fan Yang, Wenchuan Wang, et al. · Nature Machine Intelligence · 862
2021 · Shekoofeh Azizi, Basil Mustafa, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 858
2023 · Nguyen, Tung, Brandstetter, Johannes, et al. · arXiv (Cornell University) · 797
2022 · Hugo Touvron, Matthieu Cord, et al. · Lecture notes in computer science · 757
2021 · Ross Irwin, Spyridon Dimitriadis, et al. · Machine Learning Science and Technology · 626
2022 · Ahmad, Walid, Simon, Elana, et al. · arXiv (Cornell University) · 580
2024 · Ziyang Ma, Zhisheng Zheng, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 551
2022 · Carl Edwards, Tuan Lai, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 543
2023 · Firas Khader, Gustav Müller-Franzes, et al. · Scientific Reports · 535
2022 · Ma, Yecheng Jason, Sodhani, Shagun, et al. · arXiv (Cornell University) · 483
2021 · Enze Xie, Jian Ding, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 476
2022 · Renrui Zhang, Ziyu Guo, et al. · neural information processing systems · 457
Works count: 3,830
Citation count: 102,000
Year
Topic
Type