Work

Evaluation of retrieval-augmented generation (RAG) with GPT-4o for maxillofacial prosthodontics clinical questions.

Year: 2026

Type: article

Abstract: Background/purpose: Large language models (LLMs) offer promising education and clinical decision support to help address the global shortage of maxillofacial prosthodontists. To overcome the lack of source traceability in base LLMs, this study evaluated a retrieval-augmented generation (RAG) architecture for answering complex clinical questions. Materials and methods: An expert panel consisting of five maxillofacial prosthodontists selected 15 high-complexity clinical questions. Responses were generated using base GPT-4o and a naive RAG-GPT-4o model built with domain-specific literatures. Outputs were evaluated across five parameters using a 5-point Likert scale and analyzed via Mann-Whitney U tests. Results: = 0.234). Conclusion: This study demonstrates that GPT-4o possesses significant latent expertise in maxillofacial prosthodontics for clinical questions. While the base LLM and a naive RAG architecture performed comparably across predefined clinical parameters, RAG integration provided an essential advantage: verifiable factual grounding. By anchoring AI outputs in transparent, evidence-based literature, RAG addresses the critical need for clinical safety and clinician trust. Ultimately, while base LLMs offer substantial clinical reasoning capabilities, pairing them with RAG architectures remains necessary to ensure the accountability required for safe integration into specialized dental care, establishing a foundation for future development of more advanced RAG systems.

Source: PubMed Central

DOI: 10.1016/j.jds.2025.07.3504