Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Year: 2025
Type: article
Abstract: With the increasing integration of artificial intelligence into various applications across industries, numerous institutions are striving to establish requirements for AI systems to be considered trustworthy, such as fairness, privacy, robustness, or transparency. For the implementation of Trustworthy AI into real-world applications, these requirements need to be operationalized, which includes evaluating the extent to which these criteria are fulfilled. This survey contributes to the discourse by outlining the current understanding of trustworthiness and its evaluation. Initially, existing evaluation frameworks are analyzed, from which common dimensions of trustworthiness are derived. For each dimension, the literature is surveyed for evaluation strategies, specifically focusing on quantitative metrics. By mapping these strategies to the machine learning lifecycle, an evaluation framework is derived, which can serve as a foundation towards the operationalization of Trustworthy AI.
Source: ACM Computing Surveys
DOI: 10.1145/3721976
Authors: Nils Kemmerzell, Annika Schreiner, Haroon Khalid, Michael Schalk, Letizia Bordoli
Institution: Friedrich-Alexander-Universität Erlangen-Nürnberg
Language: English
Subfield: Safety Research
Field: Social Sciences
Domain: Social Sciences
Open Access status: hybrid
OpenAlex ID: W4408259587