Keyword

HumanEval

Description: A benchmark for evaluating the ability of language models to generate computer programs from natural-language descriptions.
OpenAlex ID: keywords/humaneval
2021 · Chen, Mark, Tworek, Jerry, et al. · arXiv (Cornell University) · 15,129
2023 · Noah Shinn, Federico Cassano, et al. · neural information processing systems · 9,232
2023 · Rozière, Baptiste, Gehring, Jonas, et al. · arXiv (Cornell University) · 4,881
2023 · Jiawei Liu, Chunqiu Steven Xia, et al. · neural information processing systems · 2,505
2023 · Li, Raymond, Allal, Loubna Ben, et al. · arXiv (Cornell University) · 1,957
2022 · Nijkamp, Erik, Pang, Bo, et al. · arXiv (Cornell University) · 1,606
2025 · Juyong Jiang, Fan Wang, et al. · ACM Transactions on Software Engineering and Methodology · 1,488
2023 · Gunasekar, Suriya, Zhang, Yi, et al. · arXiv (Cornell University) · 1,441
2023 · Yue Wang, Hung Le, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 1,076
2023 · Luo, Ziyang, Xu, Can, et al. · arXiv (Cornell University) · 1,020
2024 · Shuyin Ouyang, Jie M. Zhang, et al. · ACM Transactions on Software Engineering and Methodology · 674
2023 · Federico Cassano, John Gouwar, et al. · IEEE Transactions on Software Engineering · 621
2023 · Huang, Dong, Zhang, Jie M., et al. · arXiv (Cornell University) · 580
2022 · Kocetkov, Denis, Li, Raymond, et al. · arXiv (Cornell University) · 553
2022 · Chen, Bei, Zhang, Fengji, et al. · arXiv (Cornell University) · 518
2024 · Kumar, Aviral, Zhuang, Vincent, et al. · arXiv (Cornell University) · 511
2024 · Kechi Zhang, Jia Li, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 489
2024 · Jia Li, Ge Li, et al. · ACM Transactions on Software Engineering and Methodology · 449
2024 · Dong, Hanze, Xiong, Wei, et al. · arXiv (Cornell University) · 431
2023 · Wei, Yuxiang, Wang, Zhe, et al. · arXiv (Cornell University) · 416
2024 · Xueying Du, Mingwei Liu, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 407
2024 · Gu, Alex, Rozière, Baptiste, et al. · arXiv (Cornell University) · 396
2023 · Muennighoff, Niklas, Liu, Qian, et al. · arXiv (Cornell University) · 389
2024 · Hao Yu, Bo Shen, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 369
2024 · Gloeckle, Fabian, Idrissi, Badr Youbi, et al. · arXiv (Cornell University) · 368
Works count: 763
Citation count: 54,940
Year
Topic
Type