Work

Suspended responsibility: The trouble with integrating researchers into shared-responsibility models for machine learning-supported decisions

Year: 2025

Type: article

Abstract: With the rise of machine learning-based decision support systems, the responsibility for potential errors is regularly questioned. Scholarly work regarding this issue has criticized a "responsibility gap," that is, unattributable responsibility for the effects of machine learning-supported decisions. One proposition to close the responsibility gap is to include scientists, who lay the basis for the functioning of machine learning models in distributed responsibility models, assigning them a share of responsibility for potential errors. However, to date, responsibility models that include scientists have not gained a foothold in regulation. To provide an empirical basis for the discussion around novel responsibility models, this study provides a social scientific analysis of an interdisciplinary machine-learning consortium that works on machine learning-based decision support systems for healthcare - an area where errors have particularly fundamental consequences for individuals. We investigate researchers' speculations about their responsibility for the downstream effects of their ML research results after translation to clinical practice. We find that researchers point to tensions in the scientific sector as well as to agential, local, and temporal shifts of their research outputs during translation to clinical practice as a major source of what we call "suspension of responsibility." Our insights contribute to debates about novel responsibility models that are fair to patients, doctors, and scientists and can inform similar debates beyond healthcare.

Source: Health An Interdisciplinary Journal for the Social Study of Health Illness and Medicine

DOI: 10.1177/13634593251377105

Authors: Theresa Willem, Alena Buyx, Ruth Müller

Institution: Technical University of Munich

Language: English

Topic: Ethics and Social Impacts of AI

Subfield: Safety Research

Field: Social Sciences

Domain: Social Sciences

Open Access status: hybrid

Estimated APC paid: $3,650

Funder: Bundesministerium für Gesundheit