How the Design of Explanations Affects Intentionality Attributions and Appropriate Reliance in AI-Augmented Decision-Making
Type: article
Abstract: Explainable AI research increasingly advocates interactive natural-language explanations to support appropriate reliance, yet dialogical designs may also alter how users interpret an AI system's intent. Drawing on attribution theory, this short paper proposes that interactive explanations heighten perceived humanness, thereby strengthening intentionality attributions — more strongly for perceptions that the system seeks to persuade than to assist — ultimately impacting reliance behavior. Additionally, decision-makers’ Locus of Control conditions whether perceived humanness is read as assistance or persuasion. Using a between-subjects online experiment in a deception-detection task, we compare recommendation-only, static explanation, and interactive explanation conditions and measure behavioral reliance on correct and incorrect AI advice. The study contributes to explainable AI research by showing how explanation design affects assistive and persuasive attributions of intent, which shape reliance behavior.
Source: AIS Electronic Library (AISeL)
Institution: University of North Carolina at Greensboro
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7222989020
