Work

Beyond Decision Making: Considering Collaboration and Agency in the Design of AI-Based Decision-Support Systems for Fast-Response Medical Teams

Year: 2025

Type: article

Abstract: In addition to aiding decision making, AI-based clinical decision-support systems may need to consider and support provider agency and collaboration between medical providers. We analyzed collaboration and agency within fast-response teams, identifying implications for designing decision-support systems that not only facilitate decision making, but also collaboration and agency. Using an Actor-Network Theory approach, we reviewed videos of 12 pediatric trauma resuscitations and conducted a secondary analysis of 27 interviews with trauma team members. We identified actants in trauma resuscitation, shifts in agency that can occur within fast-response teams during medical emergencies, and factors considered by providers when envisioning the design of decision-support systems. From our analysis, we propose implications for existing human-AI interaction guidelines when designing AI systems for fast-response medical teams. We also highlight parallels between the introduction of clinical practice guidelines and the introduction of AI-based decision-support systems, suggesting that these systems may influence the training and ''clinical gaze'' of providers.

Source: Proceedings of the ACM on Human-Computer Interaction

DOI: 10.1145/3757457

Authors: Angela Mastrianni, Paige Kmetz-Cutrone, Kathryn Chang, Jonathan Y Stein, Aleksandra Sarcevic

Institution: Drexel University

Language: English

Topic: Artificial Intelligence in Healthcare and Education

Subfield: Health Informatics

Field: Medicine

Domain: Health Sciences

SDG: Good health and well-being

Open Access status: hybrid

Funders: National Science Foundation, Children's National Hospital, National Institutes of Health, U.S. National Library of Medicine