Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence
Year: 2025
Type: article
Study design: Observational Study
Abstract: Achieving appropriate reliance on AI-based decision support systems (DSS) is a central challenge in human-AI decision-making. Both over-reliance and under-reliance can impair decision quality, underscoring the need to understand the psychological factors guiding reliance behaviour. This study examines how expertise, trust, and self-confidence relate to appropriate reliance within an AI-based DSS. Using structural equation modelling with data from 529 chess players with varying expertise-levels, we analysed direct, mediated, and moderated relationships among these factors. Results revealed no over-reliance, reflecting participants’ preference for self-reliance. Expertise was positively related to self-confidence and negatively related to trust, corresponding with a more critical stance toward AI advice. Trust was associated with reliance on accurate AI recommendations, whereas self-confidence was related to reliance on one’s own correct decisions. These findings support a relational framework linking user characteristics to behavioural reliance and inform the design of adaptive, explainable DSS that promote calibrated trust and effective decision-making.
Source: Journal of Decision System
Authors: Enis Ömer Dogru, Nicole C. Krämer
Institutions: University of Duisburg-Essen, TU Dortmund University
Language: English
Subfield: Human Factors and Ergonomics
Field: Social Sciences
Domain: Social Sciences
Open Access status: hybrid
OpenAlex ID: W4416774727
