Keyword

pre-training data

Description: Data used to train a machine-learning model before it is adapted or evaluated for a subsequent task.
Primary topic: Topic Modeling (33%)
OpenAlex ID: keywords/pre-training-data
2020 · Kelvin Guu, Kenton Lee, et al. · International Conference on Machine Learning · 2,475
2024 · Jingfeng Yang, Hongye Jin, et al. · ACM Transactions on Knowledge Discovery from Data · 1,542
2016 · Huh, Minyoung, Agrawal, Pulkit, et al. · arXiv (Cornell University) · 811
2023 · Johannes Wagner, Andreas Triantafyllopoulos, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 607
2023 · Shangbin Feng, Chan Young Park, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 566
2022 · Kandpal, Nikhil, Deng, Haikang, et al. · arXiv (Cornell University) · 367
2023 · Zhou, Kun, Zhu, Yutao, et al. · arXiv (Cornell University) · 339
2023 · Ahmed Elnaggar, Hazem Essam, et al. · bioRxiv (Cold Spring Harbor Laboratory) · 280
2023 · Kaitlyn Zhou, Dan Jurafsky, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 270
2022 · Yasaman Razeghi, Robert L Logan IV, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 245
2022 · Peter Henderson, Mark Krass, et al. · neural information processing systems · 236
2023 · Oren, Yonatan, Meister, Nicole, et al. · arXiv (Cornell University) · 223
2025 · Matarazzo, Andrea, Torlone, Riccardo · arXiv (Cornell University) · 202
2024 · Zeyang Ma, An Ran Chen, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 177
2022 · Razeghi, Yasaman, Logan, Robert L., et al. · arXiv (Cornell University) · 175
2024 · Stefan Baack · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · 148
2021 · Lisa Anne Hendricks, John Mellor, et al. · Transactions of the Association for Computational Linguistics · 146
2024 · Suproteem Sarkar, Keyon Vafa · SSRN Electronic Journal · 145
2025 · Wang, Zengzhi, Zhou, Fan, et al. · arXiv (Cornell University) · 139
2024 · Vishaal Udandarao, Ameya Prabhu, et al. · neural information processing systems · 127
2022 · Jing Zhao, Wei-Qiang Zhang · IEEE Journal of Selected Topics in Signal Processing · 126
2024 · Steenhoek, Benjamin, Rahman, Md Mahbubur, et al. · arXiv (Cornell University) · 125
2023 · Feng Cheng, Xizi Wang, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 124
2023 · Chao Tao, Ji Qi, et al. · IEEE Transactions on Geoscience and Remote Sensing · 123
2022 · Jagielski, Matthew, Thakkar, Om, et al. · arXiv (Cornell University) · 122
Works count: 358
Citation count: 13,660
Year
Topic
Type