Work

Accuracy and reliability of large language models in assessing learning outcomes achievement across cognitive domains

Year: 2024

Type: article

Abstract: The advent of large language models (LLMs) such as ChatGPT and Gemini has offered new learning and assessment opportunities to integrate artificial intelligence (AI) with education. This study evaluated the accuracy of LLMs in assessing an assignment from a course on sports physiology. Concordance and correlation between human graders and LLMs were mostly moderate to poor. The findings suggest AI's potential to complement human expertise in educational assessment alongside the need for adaptive learning by educators.

Source: AJP Advances in Physiology Education

DOI: 10.1152/advan.00137.2024

Authors: Swapna Haresh Teckwani, Amanda Huee-Ping Wong, Nathasha Vihangi Luke, Ivan Cherh Chiet Low

Institutions: National University of Singapore, National University Hospital

Language: English

Topic: Artificial Intelligence in Education

Subfield: Information Systems

Field: Computer Science

Domain: Physical Sciences

SDG: Quality education

Open Access status: diamond

OpenAlex ID: W4404174416

FWCI: 7.751

Cites: 22

Cited by: 20

Related to: 10