Work

Pilot study evaluating the usability of MonŒil, a ChatGPT-based education tool in ophthalmology

Year: 2024

Type: article

Abstract: There is an increasing use of artificial intelligence (AI) in ophthalmology to respond to the needs of patients to access reliable, easy-to-understand medical information. To assess patient satisfaction with the usability of MonŒil, an AI-based platform designed for patient education in ophthalmology. This was a pilot cross-sectional study of the usability of MonŒil by patients followed for advanced age-related macular degeneration (AMD). MonŒil is based on ChatGPT-4 technology with specific ophthalmology-focused customizations and accessibility enhancements, and is freely available at monoeil.help. Patients were given 20 minutes of unsupervised interaction with no prior training or guidance, after which their feedback was collected. The study was performed in the ophthalmology department at the Creteil University Hospital. Participants included 54 patients diagnosed with advanced AMD defined presenting for follow-up. Patients had to be older than 50 years of age, capable of giving informed consent, and able to understand and interact with MonŒil. Exclusion criteria were severe visual and cognitive impairment that prevented interaction with MonŒil. The primary outcome was the usability of MonŒil as measured by the System Usability Scale (SUS) questionnaire. Of the 54 participants, 34 were female (62.96%). The mean age of the cohort was 77.76±8.14 years (range 58 to 97 years). The mean SUS score was 90.23±12.04 with a median of 92.50 (range 42.50 to 100.00), indicating excellent usability. There was a positive relationship between visual acuity and SUS score (regression coefficient 0.30 (95% CI 0.08 to 0.51), r2=0.19, p=0.0077). MonŒil demonstrated excellent usability and satisfaction in a sample population of elderly patients with advanced AMD. These results suggest that AI-based tools like MonŒil can enhance patient education with minimal oversight in a complex field like ophthalmology, supporting its use as an adjunct to the physician-patient discussion. Further studies may be necessary to establish the applicability of MonŒil to a broader user base, and to assess its usefulness and clinical impact on patient outcomes such as patient knowledge and vision-related quality of life.

Source: AJO International

DOI: 10.1016/j.ajoint.2024.100032

Authors: Claudio XOMPERO, Walid BENETTAYEB, Eric H. SOUIED, Carl-Joe MEHANNA

Institution: Hôpital Intercommunal de Créteil

Language: English

Topic: Artificial Intelligence in Healthcare and Education

Subfield: Health Informatics

Field: Medicine

Domain: Health Sciences

SDG: Good health and well-being

Open Access status: gold

Estimated APC paid: $1,800