Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
Year: 2019
Type: conference-paper
Abstract: Clinical decision support tools (DST) promise improved healthcare outcomes by offering data-driven insights. While effective in lab settings, almost all DSTs have failed in practice. Empirical research diagnosed poor contextual fit as the cause. This paper describes the design and field evaluation of a radically new form of DST. It automatically generates slides for clinicians' decision meetings with subtly embedded machine prognostics. This design took inspiration from the notion of Unremarkable Computing, that by augmenting the users' routines technology/AI can have significant importance for the users yet remain unobtrusive. Our field evaluation suggests clinicians are more likely to encounter and embrace such a DST. Drawing on their responses, we discuss the importance and intricacies of finding the right level of unremarkableness in DST design, and share lessons learned in prototyping critical AI systems as a situated experience.
Authors: Qian Yang, Aaron Steinfeld, John Zimmerman
Institution: Carnegie Mellon University
Language: English
Subfield: Health Informatics
Field: Medicine
Domain: Health Sciences
Open Access status: green
Funders: Foundation for Research, Science and Technology, Department of Science and Technology, Ministry of Science and Technology, India, National Institutes of Health, National Heart, Lung, and Blood Institute, Center for Machine Learning and Health, School of Computer Science, Carnegie Mellon University
OpenAlex ID: W4288359828
