Keyword

MBPP

Description: A benchmark of basic Python programming problems used to evaluate the code-generation abilities of large language models.
OpenAlex ID: keywords/mbpp
2021 · Austin, Jacob, Odena, Augustus, et al. · arXiv (Cornell University) · 5,798
2023 · Rozière, Baptiste, Gehring, Jonas, et al. · arXiv (Cornell University) · 4,881
2025 · Juyong Jiang, Fan Wang, et al. · ACM Transactions on Software Engineering and Methodology · 1,488
2023 · Gunasekar, Suriya, Zhang, Yi, et al. · arXiv (Cornell University) · 1,441
2023 · Luo, Ziyang, Xu, Can, et al. · arXiv (Cornell University) · 1,020
2023 · Federico Cassano, John Gouwar, et al. · IEEE Transactions on Software Engineering · 621
2023 · Huang, Dong, Zhang, Jie M., et al. · arXiv (Cornell University) · 580
2022 · Kocetkov, Denis, Li, Raymond, et al. · arXiv (Cornell University) · 553
2022 · Chen, Bei, Zhang, Fengji, et al. · arXiv (Cornell University) · 518
2024 · Jia Li, Ge Li, et al. · ACM Transactions on Software Engineering and Methodology · 449
2024 · Gloeckle, Fabian, Idrissi, Badr Youbi, et al. · arXiv (Cornell University) · 368
2024 · Tianyu Zheng, Ge Zhang, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 353
2023 · John Yang, Akshara Prabhakar, et al. · neural information processing systems · 331
2024 · Li Zhong, Zilong Wang, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 304
2025 · Feng Lin, Dong Jae Kim, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 171
2024 · Wang, Chaojie, Deng, Yanchen, et al. · arXiv (Cornell University) · 154
2025 · Zhangchen Xu, Yang Liu, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 139
2024 · Noble Saji Mathews, Meiyappan Nagappan · IEEE/ACM International Conference on Automated Software Engineering (ASE) · 135
2022 · Lahiri, Shuvendu K., Fakhoury, Sarah, et al. · arXiv (Cornell University) · 131
2024 · Wang, Evan, Cassano, Federico, et al. · arXiv (Cornell University) · 113
2025 · Huaye Zeng, Dongfu Jiang, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 112
2024 · Dagan, Gautier, Synnaeve, Gabriel, et al. · arXiv (Cornell University) · 108
2025 · Jia Li, Chongyang Tao, et al. · ACM Transactions on Software Engineering and Methodology · 105
2025 · Minh Huynh Nguyen, Thang Phan Chau, et al. · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · 96
2024 · Yangruibo Ding, Marcus J. Min, et al. · Proceedings of the ACM on Programming Languages · 94
Works count: 389
Citation count: 22,040
Year
Topic
Type