The Role of XAI in Advice-Taking from a Clinical Decision Support System: A Comparative User Study of Feature Contribution-Based and Example-Based Explanations
Year: 2022
Type: article
Abstract: Explainable artificial intelligence (XAI) has shown benefits in clinical decision support systems (CDSSs); however, it is still unclear to CDSS developers how to select an XAI method to optimize the advice-taking of healthcare practitioners. We performed a user study on healthcare practitioners based on a machine learning-based CDSS for the prediction of gestational diabetes mellitus to explore and compare two XAI methods: explanation by feature contribution and explanation by example. Participants were asked to make estimates for both correctly and incorrectly predicted cases to determine if there were any over-reliance or self-reliance issues. We examined the weight of advice and healthcare practitioners’ preferences. Our results based on statistical tests showed no significant difference between the two XAI methods regarding the advice-taking. The CDSS explained by either method had a substantial impact on the decision-making of healthcare practitioners; however, both methods may lead to over-reliance issues. We identified the inclination towards CDSS use as a key factor in the advice-taking from an explainable CDSS among obstetricians. Additionally, we found that different types of healthcare practitioners had differing preferences for explanations; therefore, we suggest that CDSS developers should select XAI methods according to their target users.
Source: Applied Sciences
DOI: 10.3390/app122010323
Authors: Yuhan Du(Conceptualization, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing), Anna Markella Antoniadi(Investigation, Methodology, Writing – review & editing), Catherine McNestry(Investigation, Methodology, Writing – review & editing), Fionnuala M. McAuliffe(Investigation, Methodology, Writing – review & editing), Catherine Mooney(Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing)
Institutions: University College Dublin, National Maternity Hospital
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,408
Funder: University College Dublin
OpenAlex ID: W4306149475
