Work

An analysis of the generative AI use as analyst in qualitative research in science education

Year: 2024

Type: article

Abstract: The article evaluates the effectiveness of generative artificial intelligence models, specifically ChatGPT 4.0 and Claude 2.0, in conducting qualitative research within the field of scientific education. By applying the Cognitive Networks Mediation Theory (CNMT) to analyze interviews from two students, it was found that Claude 2.0 surpassed ChatGPT 4.0 in recognizing cognitive mediations and distinguishing between pre- and post-test conditions. Although both models concurred on the concept of conceptual evolution, Claude 2.0 demonstrated a greater capacity for detail, notably by referencing specific interview excerpts to support its analyses upon request. In contrast, ChatGPT 4.0 exhibited difficulties in these areas, even when given additional prompts. The study concludes by acknowledging the utility of AI, particularly Claude 2.0, for qualitative research, while also emphasizing the critical role of human oversight in detecting potential deficiencies within these models.

Source: Revista Pesquisa Qualitativa

DOI: 10.33361/rpq.2024.v.12.n.30.724

Authors: Juliana Rodrigues dos Anjos, Maira Giovana De Souza, Agostinho Serrano de Andrade Neto, Bruno Campello de Souza

Institutions: Universidade Luterana do Brasil, Universidade Federal de Pernambuco

Language: English

Topic: Artificial Intelligence in Education

Subfield: Education

Field: Social Sciences

Domain: Social Sciences

SDG: Quality education

Open Access status: diamond

OpenAlex ID: W4396560170

FWCI: 12.54

Cites: 26

Cited by: 31

Related to: 10