Work

The Unexpected Harms of Artificial Intelligence in Healthcare: Reflections on Four Real-World Cases

Year: 2025

Type: book-chapter

Abstract: INTRODUCTION: Rapid advances in Artificial Intelligence (AI), especially with large language models, present both opportunities and challenges in healthcare. This article analyzes real-world AI-related harms in healthcare. METHODS: We selected four recent AI-related incidents from the AIAAIC Repository. RESULTS: The incidents discussed include: Whisper's harmful hallucinations; UNOS's algorithm delaying transplants for black patients; the WHO's S.A.R.A.H. chatbot providing inaccurate health information; and Character AI's chatbot promoting disordered eating among teens. DISCUSSION AND CONCLUSION: These incidents highlight diverse risks, from misinformation to safety concerns, involving both industry and institutional providers. The article emphasizes the need for systematic reporting of AI-related harms, concerns about security, privacy, and ethics, and calls for a centralized health-specific database to enhance patient safety and understanding.

Source: Studies in health technology and informatics

DOI: 10.3233/shti250219

Authors: Kerstin Denecke, Guillermo Lopez-Campos, Octavio Rivera-Romero, Elia Gabarron

Institutions: Bern University of Applied Sciences, Queen's University Belfast, Universidad de Sevilla, Østfold University of Applied Sciences

Language: English

Topic: Artificial Intelligence in Healthcare and Education

Subfield: Health Informatics

Field: Medicine

Domain: Health Sciences

SDG: Good health and well-being

Open Access status: hybrid

OpenAlex ID: W4410125230

FWCI: 15.1

Cites:

Cited by: 9

Related to: 10