Explainable Dual‐Stream Attention Network for Image Forgery Detection and Localisation Using Contrastive Learning
Year: 2025
Type: article
Abstract: ABSTRACT Image forgery detection aims to identify tampered content and localise manipulated regions within images. With the rise of advanced editing tools, forgeries pose serious challenges across media, law and scientific domains. Existing CNN‐based models struggle to detect subtle manipulations that mimic natural image patterns. To address this challenge, we propose a dual‐stream contrastive learning network (DSCL‐Net) that jointly exploits spatial (pixel‐level) and frequency (noise‐level) cues. The architecture employs two ResNet‐50 encoders: one processes the red–green–blue (RGB) image to capture semantic context, whereas the other processes a spatial rich model (SRM) filtered version to extract high‐frequency forensic traces. A multi‐scale attention fusion module enhances manipulation‐sensitive features. The network includes three heads: a classification head for image‐level prediction, a segmentation head for pixel‐wise localisation, and a contrastive projection head to improve feature discrimination. We validate the effectiveness of our proposed model on two benchmark datasets. The proposed DSCL‐Net surpasses previous state‐of‐the‐art methods by achieving an image‐level accuracy of 97.9% on the CASIA and 89.8% on IMD2020. At the pixel level, it attains an F 1‐score of 92.7% and an AUC of 91.2% on CASIA, and an F 1‐score of 86.6% with an AUC of 90.1% on IMD2020. Furthermore, LIME and SHAP have been employed to provide explainability at individual image level to comprehend the alignment of the predicted mask with the ground truth mask. The developed approach contributes to the development of safe technology for dealing with misinformation and fake news.
Source: IET Radar Sonar & Navigation
DOI: 10.1049/rsn2.70064
Authors: Maryam Munawar, Mourad Oussalah
Institution: University of Oulu
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,620
Funder: Oulun Yliopisto
OpenAlex ID: W4413030494