Work

Evaluating the quality and empathy of responses to patient questions on the Korean Academy of Periodontology’s online question and answer section: a cross-sectional study comparing periodontists and an AI-powered chatbot

Year: 2025

Type: article

Abstract: PURPOSE: This study aimed to evaluate and compare the responses of an artificial intelligence (AI)-powered chatbot and professional periodontists to patient queries in periodontology and implantology, using the Korean Academy of Periodontology's (KAP) online question and answer (Q&A) section. METHODS: -test and Spearman correlation coefficients to compare response quality, empathy, consistency, and evaluator preferences. RESULTS: <0.001). Overall response consistency was deemed satisfactory at 64.2%, with no significant difference in consistency or preference between periodontist and lay evaluators. CONCLUSIONS: AI-powered chatbots can deliver more accurate and empathetic answers than human periodontists, suggesting their potential role as consultation assistants merits further investigation. The high intraclass correlation coefficient values (0.79-0.93) indicate a high level of agreement among evaluators in both the periodontist and lay evaluator groups, thus confirming the reliability and robustness of the study's assessment methodology.

Source: Journal of Periodontal & Implant Science

DOI: 10.5051/jpis.2402220111

Authors: Jae-Hong Lee, So-Hae Oh, Falk Schwendicke, Akhilanand Chaurasia, Young-Taek Kim

Institutions: Jeonbuk National University Hospital, Jeonbuk National University, Ludwig-Maximilians-Universität München, King George's Medical University, National Health Insurance Service Ilsan Hospital

Language: English

Topic: Artificial Intelligence in Healthcare and Education

Subfield: Health Informatics

Field: Medicine

Domain: Health Sciences

SDG: Good health and well-being

Open Access status: hybrid

Funder: Ministry of Health and Welfare