Work

GPTEval: A Survey on Assessments of ChatGPT and GPT-4

Year: 2024

Type: conference-paper

Abstract: The emergence of ChatGPT has generated much speculation in the press about its potential to disrupt social and economic systems.Its astonishing language ability has aroused strong curiosity among scholars about its performance in different domains.There have been many studies evaluating the ability of ChatGPT and GPT-4 in different tasks and disciplines.However, a comprehensive review summarizing the collective assessment findings is lacking.The objective of this survey is to thoroughly analyze prior assessments of ChatGPT and GPT-4, focusing on its language and reasoning abilities, scientific knowledge, and ethical considerations.Furthermore, an examination of the existing evaluation methods is conducted, offering several recommendations for future research.

Source: Language Resources and Evaluation Conference (LREC)

DOI: 10.63317/3dhqzf3tvt2z

Authors: Rui Mao, Guanyi Chen, Xulang Zhang, Frank Guerin, Erik Cambria

Institutions: Nanyang Technological University, University of Surrey

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: bronze

Funders: Ministry of Education - Singapore, Ministry of Education, India, Central China Normal University

Awards: G155108461, G199814813, G5692239388, G5987483165, G6854926366