Keyword

benchmark contamination

Description: The inclusion of benchmark evaluation material in a model’s training data, which can compromise the validity of its reported performance.
Primary topic: Topic Modeling (32%)
OpenAlex ID: keywords/benchmark-contamination
2024 · Jain, Naman, Han, King, et al. · arXiv (Cornell University) · 1,802
2023 · Oscar Sainz, Jon Campos, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 620
2024 · Yihong Dong, Xue Jiang, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 312
2025 · Mislav Balunovic, Jasper Dekoninck, et al. · neural information processing systems · 299
2023 · Yang, Shuo, Chiang, Wei-Lin, et al. · arXiv (Cornell University) · 273
2025 · Ibragim Badertdinov, Alexander Golubev, et al. · neural information processing systems · 222
2025 · Linghao Zhang, Shilin He, et al. · neural information processing systems · 199
2024 · Yucheng Li, Yunhao Guo, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 153
2023 · Elazar, Yanai, Bhagia, Akshita, et al. · arXiv (Cornell University) · 119
2024 · Jinjie Ni, Fuzhao Xue, et al. · neural information processing systems · 87
2026 · Shanchao Liang, Spandan Garg, et al. · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · 83
2025 · Nick Pangakis, Sam Wolken · Proceedings of the International AAAI Conference on Web and Social Media · 78
2025 · Qihao Zhao, Yangyu Huang, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 62
2024 · Chunyuan Deng, Yilun Zhao, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 62
2024 · Ishaan Watts, Varun Gumma, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 62
2024 · Banerjee, Sourav, Agarwal, Ayushi, et al. · arXiv (Cornell University) · 53
2024 · Feng Yao, Yufan Zhuang, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 47
2024 · Dekoninck, Jasper, Müller, Mark Niklas, et al. · arXiv (Cornell University) · 41
2024 · Matton, Alexandre, Sherborne, Tom, et al. · arXiv (Cornell University) · 40
2024 · Wenhong Zhu, Hongkun Hao, et al. · Findings of the Association for Computational Linguistics: NAACL · 35
2024 · Wu, Jian, Yang, Linyi, et al. · arXiv (Cornell University) · 34
2025 · Mahdavi, Sadegh, Li, Muchen, et al. · arXiv (Cornell University) · 33
2026 · Chollet, François, Knoop, Mike, et al. · arXiv (Cornell University) · 29
Works count: 218
Citation count: 5,310
Year
Topic
Type