Year: 2026
Type: article
Study design: Observational Study
Abstract: Clinical history-taking and documentation are foundational competencies in undergraduate medical training, yet scalable and individualized training tools remain limited. Large language model (LLM)-based systems provide automated practice opportunities but often lack structured medical reasoning, closed-loop instructional design, and integration into formal curricula. As part of a curriculum reform initiative, we constructed a clinical case repository, developed an artificial intelligence (AI)-integrated faculty Plan–Do–Check–Act (PDCA) training framework supported by dual chain-of-thought (CoT)-driven LLMs, and evaluated the reliability of AI-based scoring against faculty assessment. We then conducted a retrospective observational analysis of routinely collected educational performance data from 135 undergraduate medical students enrolled in one of three existing instructional configurations: traditional instruction, AI-assisted training, or AI + PDCA training. Educational outcomes were assessed using standardized Objective Structured Clinical Examination (OSCE) assessments. The AI + PDCA configuration was associated with the highest OSCE performance in both history-taking and clinical documentation. Among the two AI-supported configurations, longitudinal mixed-effects modeling showed steeper learning trajectories in the AI + PDCA configuration than in the AI-assisted configuration. These findings suggest that integrating AI-derived learning analytics with faculty-guided instructional intervention may support a closed-loop educational model associated with favorable competency acquisition while maintaining human oversight. This framework offers a scalable approach for implementing trustworthy, competency-based AI-enhanced medical education in routine academic practice.
Source: npj Digital Medicine
Authors: Zijin Chen(Conceptualization, Formal analysis, Methodology, Visualization, Writing – original draft, Writing – review & editing), Yinru Chen(Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft, Writing – review & editing), Weiguo Hu(Data curation, Investigation, Methodology, Writing – review & editing), Lifeng Zhu(Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing), Lin Hu(Investigation, Writing – review & editing), Yan Ouyang(Investigation, Writing – review & editing), Xuelian Wang(Data curation, Investigation, Visualization, Writing – review & editing), Jiaxiang Wu(Investigation, Methodology, Software, Writing – review & editing), Shaoxin Li(Formal analysis, Investigation, Methodology, Software, Writing – review & editing), Boyuan Deng(Data curation, Formal analysis, Investigation, Software, Visualization, Writing – review & editing), Weiqiong Gu(Data curation, Investigation, Writing – review & editing), Feiyue Huang(Conceptualization, Methodology, Supervision, Writing – review & editing), Qian Gu(Conceptualization, Methodology, Supervision, Writing – review & editing)
Institutions: Shanghai Jiao Tong University, Ruijin Hospital
Language: English
Subfield: Health Informatics
Field: Medicine
Domain: Health Sciences
Open Access status: gold
Estimated APC paid: $4,090
Award: G4485996581
OpenAlex ID: W7234425883
