Work

Reporting of Qualitative Research Using Large Language Models (COREQ+LLM): A Delphi-based Extension of the COREQ Reporting Guideline

Year: 2026
Type: preprint
Abstract: Background Qualitative research provides insights into human behavior, perspectives, and lived experience. While existing standards like the Consolidated Criteria for Reporting Qualitative Research (COREQ) have improved transparency and rigor, the integration of large language models (LLMs) into qualitative research introduces new challenges for not covered by current guidelines. LLMs transform analytic processes and blur the line between human interpretation and algorithmic text generation, raising concerns about transparency, authorship, and epistemic trust. The here presented COREQ+LLM guideline extends COREQ to establish comprehensive reporting standards for LLM use in qualitative research. Methods The study followed the EQUATOR Network’s guideline development framework in two phases: (1) a systematic scoping review to identify best practices for reporting LLM use in qualitative research, and (2) a Delphi consensus process with international experts in qualitative research, AI, medicine, ethics, and journal editing to develop a comprehensive reporting checklist. Findings The scoping review identified 149 studies relevant for full-text review. From this literature, 29 preliminary reporting items were extracted. In the first Delphi round, international experts (N=141) assessed the items’ relevance. 20 items were accepted for inclusion in the guideline (>75% agreement); however, four required reevaluation in the second round, five underwent wording revisions, and six new items were proposed. In the second Delphi round (N=115; retention rate 82%), one was excluded, while four items still lacked consensus. Remaining items were discussed in a virtual consensus conference with nine representatives of the expert panel, resulting in the inclusion of two and the exclusion of two others. The final checklist comprises 31 items grouped into seven categories, serving as an extension of the original COREQ checklist. Interpretation COREQ+LLM offers structured, consensus-based guidance to enhance transparency, reproducibility, and methodological rigor in qualitative research using LLMs. Its adoption will support researchers, reviewers, and editors in maintaining trust and scientific integrity.
Source: medRxiv
Language: English
Subfield: Education
Open Access status: green
Funders: Yale University, University of Southern California, University of Pennsylvania, University of Chicago, Ankara Universitesi, North Carolina State University, University of Washington, Universiti Tun Hussein Onn Malaysia, University of Rochester, RTI International, Auckland University of Technology, New Zealand, New York University Shanghai, Texas Christian University, Západočeská Univerzita v Plzni, University of Bern, McMaster University, University of Essex, Bridgewater State University, University of Texas Health Science Center at Houston, Instituto de Investigaciones Gino Germani, University of Rwanda, University of Alberta, University of Oxford, University of Bath, National University of Singapore, University of Sydney, Deakin University, Erasmus Universiteit Rotterdam, Universiteit Utrecht, Albert-Ludwigs-Universität Freiburg, Bar-Ilan University, Consejo Nacional de Investigaciones Científicas y Técnicas, University of Surrey, Universitair Medisch Centrum Utrecht, Helwan University, Isfahan University of Medical Sciences, Università degli Studi di Trento, East China Normal University, Orta Doğu Teknik Üniversitesi, Universität Potsdam, Tel Aviv University, Universiti Teknologi MARA, Nanjing University of Science and Technology, Universidad de Buenos Aires, Instituto Tecnológico de Costa Rica, Universität Regensburg, Goethe-Universität Frankfurt am Main, Universidade de Coimbra, Universidad de Concepción, University of Johannesburg, Universidade do Estado do Rio de Janeiro, Université Paris-Saclay, Tshwane University of Technology, Southeast University, Uniwersytet Wrocławski, Universitas Airlangga, Karl-Franzens-Universität Graz, Nazarbayev University, Kauno Technologijos Universitetas, School of Medicine, Duke University, Weill Cornell Medical College, University of North Carolina at Chapel Hill, University of California, San Diego, Zürcher Hochschule für Angewandte Wissenschaften
OpenAlex ID: W7220394011
Cites: 26
Cited by:
Related to: 10