Work

Zero or Hero? Exploring the Use of AI Tools for Thematic Analysis in Science Communication Evaluation

Year: 2026

Type: article

Abstract: Practitioners in informal science learning institutions are often expected to analyse evaluation data with limited time and expertise, and some are turning to artificial intelligence (AI) tools for support. To examine what these tools can realistically offer, we used interview data from an outreach event. We compared single-prompt thematic analyses produced by five AI tools with each other and with an iterative practitioner–AI analysis. We also explored how qualitative researchers judged the feasibility, trustworthiness and practical value of AI support. The AI tools consistently identified core patterns, but their outputs were largely descriptive, varied across trials and included hallucinated quotes. We recommend a hybrid approach in which AI assists with organising data while researchers retain responsibility for interpretation.

Source: Journal of Museum Education

DOI: 10.1080/10598650.2026.2749220

Authors: Neta Shaby, Ran Peleg, Natalie Whitehead, Athina Thoma, Ian Coombs

Language: English

Topic: Computational and Text Analysis Methods

Subfield: General Social Sciences

Field: Social Sciences

Domain: Social Sciences

SDG: Quality education

Open Access status: hybrid

Funders: University of Southampton, Economic and Social Research Council

OpenAlex ID: W7224802015

FWCI:

Cites: 19

Cited by:

Related to: 10