Work

Designing Effective AI Explanations for Misinformation Detection: A Comparative Study of Content, Social, and Combined Explanations

Year: 2025

Type: article

Abstract: In this paper, we study the problem of AI explanation of misinformation, where the goal is to identify explanation designs that help improve users' misinformation detection abilities and their overall user experiences. Our work is motivated by the limitation of current Explainable AI (XAI) approaches, which predominantly focus on content explanations that elucidate the linguistic features and sentence structures of the misinformation. To address this limitation, we explore various explanations beyond content explanation, such as ''social explanation'' that considers the broader social context surrounding misinformation, as well as a ''combined explanation'' where both the content and social explanations are presented in scenarios that are either aligned or misaligned with each other. To evaluate the comparative effectiveness of these AI explanations, we conduct two online crowdsourcing experiments in COVID-19 (Study 1 on Prolific) and Politics domains (Study 2 on MTurk). Our results show that AI explanations are generally effective in aiding users to detect misinformation, with effectiveness significantly influenced by the alignment between content and social explanations. We also find that the order in which explanation types are presented-specifically, whether a content or social explanation comes first-can influence detection accuracy, with differences found between the COVID-19 and Political domains. This work contributes towards more effective design of AI explanations, fostering a deeper understanding of how different explanation types and their combinations influence misinformation detection.

Source: Proceedings of the ACM on Human-Computer Interaction

DOI: 10.1145/3757577

Authors: Yeaeun Gong, Yifan Liu, Lanyu Shang, Na Wei, Dong Wang

Institutions: University of Illinois Urbana-Champaign, Loyola Marymount University

Language: English

Topic: Misinformation and Its Impacts

Subfield: Sociology and Political Science

Field: Social Sciences

Domain: Social Sciences

Open Access status: hybrid

Funder: National Science Foundation

Awards: HCC: Small: Crowd-Assisted Human-AI Teaming with Explanations, CHS: Small: DeepCrowd: A Crowd-assisted Deep Learning-based Disaster Scene Assessment System with Active Human-AI Interactions, FairFL-MC: A Metacognitive Calibration Intervention Powered by Fair and Private Machine Learning, CAREER: Towards Reliable and Optimized Data-Driven Cyber-Physical Systems using Human-Centric Sensing, SCC-PG: Proactive Community Health Protection Against Airborne Diseases through Intelligent and Timely Pathogen Monitoring and Communication