Work

How trustworthy is ChatGPT? The case of bibliometric analyses

Year: 2023
Type: article
Abstract: The introduction of the AI-powered chatbot ChatGPT by OpenAI has sparked much interest and debate among academic researchers. Commentators from different scientific disciplines have raised many concerns and issues, especially related to the ethics of using these tools in scientific writing and publications. In addition, there has been discussions about whether ChatGPT is trustworthy, effective, and useful in increasing researchers’ productivity. Therefore, in this paper, we evaluate ChatGPT’s performance on tasks related to bibliometric analysis, by comparing the output provided by the chatbot with a recently conducted bibliometric study on the same topic. The findings show that there are large discrepancies and ChatGPT’s trustworthiness is low in this particular area. Therefore, researchers should exercise caution when using ChatGPT as a tool in bibliometric studies.
Language: English
Open Access status: gold
Estimated APC paid: $1,165
OpenAlex ID: W4381988031
FWCI: 19.25
Cites: 30
Cited by: 76
Related to: 10