Evaluating ChatGPT-4o's accuracy in answering American Board of Dermatology practice questions: an analysis of AI in dermatology residency education
Year: 2025
Type: article
Abstract: Artificial intelligence may enhance medical education. This study evaluates ChatGPT-4o's accuracy in answering sample questions from the American Board of Dermatology BASIC, CORE, and APPLIED examinations. Fifty publicly available questions, with and without images, were analyzed for accuracy and performance across difficulty levels and categories. Its performance varied significantly between text-only and image-based questions, with lower accuracy on image-based questions (47%). Improvements in artificial intelligence for the use in dermatology residency education are necessary, as limitations in visual diagnostic skills were evident.
Source: Dermatology Online Journal
DOI: 10.25251/bvjddn46
Authors: Lauren McGrath, Nathan Schedler, Sarah Martin, Matthew Hrin, Maria Mariencheck, Steven Feldman, Zeynep Akkurt
Language: English
Subfield: Health Informatics
Field: Medicine
Domain: Health Sciences
Open Access status: gold
Estimated APC paid: $300
OpenAlex ID: W4415489145
FWCI:
Cites:
Cited by:
Related to:
