Work

Who Decides When Artificial Intelligence Works? Algorithmic Production as a Continuous Evaluation Process

Year: 2025

Type: article

Abstract: The intensifying deployment of AI systems in different spheres of our lives has raised concerns over their evaluation. The latter has often been discussed as a unified process that any model should undergo before its release and use. However, we argue that throughout their production AI systems are continuously assessed. A closer look at their supply chains reveal modes and practices of evaluation at each stage of their development. Based on empirical research of three sites of AI development, this article provides evidence for this continuous assessment. It points to the limits of common perspectives on AI evaluation and argues for a more grounded and comprehensive understanding of the ways in which AI systems can be and are assessed.

Source: Digital Society

DOI: 10.1007/s44206-025-00224-4

Authors: Assia Wirth, Clément Le Ludec, Camille Girard-Chanudet, Maxime Cornet

Institutions: Université Paris-Saclay, Université Paris-Panthéon-Assas, Université Panthéon-Assas, Conservatoire National des Arts et Métiers, Télécom Paris

Language: English

Topic: Ethics and Social Impacts of AI

Subfield: Safety Research

Field: Social Sciences

Domain: Social Sciences

Open Access status: hybrid

Estimated APC paid: $3,190

Funders: Agence Nationale de la Recherche, Université Paris-Saclay