Keyword

code generation benchmarks

Description: Evaluation datasets and tasks used to measure systems’ ability to generate computer programs from specifications or other inputs.
OpenAlex ID: keywords/code-generation-benchmarks
2023 · Rozière, Baptiste, Gehring, Jonas, et al. · arXiv (Cornell University) · 4,900
2023 · Federico Cassano, John Gouwar, et al. · IEEE Transactions on Software Engineering · 625
2025 · Jenny Zhang, Shengran Hu, et al. · SuperIntelligence - Robotics - Safety & Alignment · 478
2024 · Xueying Du, Mingwei Liu, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 410
2024 · Hao Yu, Bo Shen, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 369
2023 · John Yang, Akshara Prabhakar, et al. · neural information processing systems · 331
2024 · Minyang Tian, Luyu Gao, et al. · neural information processing systems · 299
2022 · Lai, Yuhang, Li, Chengxi, et al. · arXiv (Cornell University) · 222
2025 · Quan, Shanghaoran, Yang, Jiaxi, et al. · arXiv (Cornell University) · 167
2024 · Qiwei Peng, Yekun Chai, et al. · Language Resources and Evaluation Conference (LREC) · 160
2024 · Martin Riddell, Ansong Ni, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 112
2024 · Li, Jia, Li, Ge, et al. · arXiv (Cornell University) · 105
2025 · Zhaojian Yu, Yilun Zhao, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 89
2024 · Zeeshan Rasheed, Muhammad Waseem, et al. · SSRN Electronic Journal · 83
2024 · Jialun Cao, Zhiyong Chen, et al. · IEEE/ACM International Conference on Automated Software Engineering (ASE) · 62
2024 · Jain, Kush, Synnaeve, Gabriel, et al. · International Conference on Learning Representations · 61
2025 · Li, Wei, Zhang, Xin, et al. · arXiv (Cornell University) · 48
2024 · Chen, Junting, Mu, Yao, et al. · arXiv (Cornell University) · 47
2024 · Dai, Jianbo, Lu, Jianqiao, et al. · arXiv (Cornell University) · 44
2024 · Mohammed Latif Siddiq, Simantika Dristi, et al. · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · 41
2026 · Wenchao Gu, Juntao Chen, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 40
2024 · Ziyu Li, Donghwan Shin · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · 39
2023 · Orlanski, Gabriel, Xiao, Kefan, et al. · arXiv (Cornell University) · 38
2024 · Yewei Han, Chen Lyu · Engineering Applications of Artificial Intelligence · 36
Works count: 147
Citation count: 9,548
Year
Topic
Type