Work

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

Year: 2026
Type: article
Abstract: Background: AI is increasingly impacting health care. Large language models (LLMs), such as ChatGPT, have shown potential in supporting clinical decision-making. However, their application in dermatology, particularly in allergen avoidance counseling for contact dermatitis, remains underexplored. Objective: This study aimed to demonstrate a potential use case for LLM responses in recommending allergen-free products for the management of contact allergies. Methods: A total of 30 allergen groups included in the international standard patch test were assessed. ChatGPT (GPT-4) was used in this study from September 2023 to January 2024. For each allergen, ChatGPT was tasked with recommending 5 allergen-free products using 3 question formats of varying complexity. Responses were included if they specified a product and were manually classified by dermatologists into 5 categories: valid, invalid, cross-reaction, unknown, and unresponsive. Results: ChatGPT provided 79.20% (1782/2250) valid responses, with 1.78% (40/2250) classified as invalid, 2% (45/2550) classified as cross-reactions, 8.67% (195/2250) classified as unknown, and 8.36% (188/2250) classified as unresponsive. The simplest question format yielded the highest proportion of valid recommendations (640/750, 85.33%). ChatGPT performed best when recommending cosmetics (1233/1365, 90.33%) and medications (198/240, 82.5%). However, lower validity rates were observed for recommendations involving certain sensitive allergens, including fragrance mixes and para-phenylenediamine (PPD), with frequent cross-reactive recommendations related to Peru balsam. Conclusions: The version of ChatGPT evaluated in this study showed potential as a supplementary tool for allergen avoidance counseling. However, its recommendations require verification and should not replace clinician guidance or established allergen avoidance resources.
Language: English
Field: Medicine
Open Access status: diamond
OpenAlex ID: W7235415875
FWCI:
Cites: 22
Cited by:
Related to: 10