Work

The Effect of Communicating AI Confidence on Human Decision Making When Performing a Binary Decision Task

Year: 2024

Type: article

Abstract: In this study, we experimentally analyzed whether people can perceive the accuracy or smartness of AI judgments, and whether the judgment accuracy of AI and the level of confidence in those judgments affect people’s decision-making. The results showed that people may perceive an AI’s smartness even when it only presents information on the results of its judgments. The results also suggest that AI accuracy and confidence affect human decision-making, and that the magnitude of the effect of AI confidence varies with AI accuracy. We also found that when a person’s ability to make a decision is less than or equal to the AI’s ability to make a decision, the human performance in a binary decision task improves regardless of AI accuracy. The results obtained in this study are similar in some respects to relationships in which people make decisions while interacting, and the findings from research on human interactions may apply to the research and development of human–AI interactions.

Source: Applied Sciences

DOI: 10.3390/app14167192

Authors: Nanami Ishizu, Wen Liang Yeoh, Hiroshi Okumura, Osamu Fukuda

Institution: Saga University

Language: English

Topic: Human-Automation Interaction and Safety

Subfield: Social Psychology

Field: Psychology

Domain: Social Sciences

Open Access status: gold

Estimated APC paid: $2,728

Funder: Japan Society for the Promotion of Science