Keyword

generative pre-training

Description: Generative pre-training is a machine-learning approach that trains a model to generate or predict data representations before task-specific adaptation.
OpenAlex ID: keywords/generative-pre-training
2011 · Abdel-rahman Mohamed, George E. Dahl, et al. · IEEE Transactions on Audio Speech and Language Processing · 1,954
2020 · Yizhe Zhang, Siqi Sun, et al. · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · 1,612
2020 · Ziniu Hu, Yuxiao Dong, et al. · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 777
2019 · Zhang, Yizhe, Sun, Siqi, et al. · arXiv (Cornell University) · 515
2024 · Liu, Yong, Zhang, Haoran, et al. · arXiv (Cornell University) · 432
2021 · Zhang, Zaixi, Liu, Qi, et al. · arXiv (Cornell University) · 364
2023 · Wu, Hongtao, Jing, Ya, et al. · International Conference on Learning Representations · 351
2012 · Abdel-rahman Mohamed, Geoffrey Hinton, et al. · IEEE International Conference on Acoustics Speech and Signal Processing · 329
2023 · Guangyan Chen, Meiling Wang, et al. · neural information processing systems · 262
2020 · Yu-An Chung, James Glass · IEEE International Conference on Acoustics Speech and Signal Processing · 217
2023 · Kevin Clark, Priyank Jaini · neural information processing systems · 197
2023 · Weilai Xiang, Hongyu Yang, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 192
2022 · Saikat Chakraborty, Toufique Ahmed, et al. · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · 180
2023 · Tian, Keyu, Jiang, Yi, et al. · arXiv (Cornell University) · 163
2020 · Wei Yu, Yichao Lu, et al. · International Conference on Learning Representations · 151
2021 · Zhengyan Zhang, Xu Han, et al. · AI Open · 148
2023 · Zequn Liu, Wei Zhang, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 140
2023 · Chen Wei, Karttikeya Mangalam, et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 134
2021 · Zhang, Zhuosheng, Zhang, Hanqing, et al. · arXiv (Cornell University) · 124
2023 · Zhonghang Li, Lianghao Xia, et al. · neural information processing systems · 109
2025 · Li, Zecheng, Zhou, Wengang, et al. · International Conference on Learning Representations · 107
2022 · Seo, Younggyo, Lee, Kimin, et al. · arXiv (Cornell University) · 87
2023 · Xu Wang, Huan Zhao, et al. · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 66
2021 · Zhou, Hao, Ke, Pei, et al. · arXiv (Cornell University) · 64
Works count: 142
Citation count: 9,919
Year
Topic
Type