Extended excitation backprop with gradient weighting: A general visualization solution for understanding heterogeneous face recognition
Year: 2025
Type: article
Abstract: Visualization methods have been used to reveal areas of images which influence the decision making of machine learning models, thereby helping to understand and diagnose the learned models and suggest ways to improve their performance. This concept is termed Explainable Artificial Intelligence. In this work, we focus on visualization methods for metric-learning based neural networks. We propose a gradient-weighted extended Excitation Back-Propagation (gweEBP) method that integrates the gradient information during its backpropagation for the accurate investigation of embedding networks. We perform an extensive evaluation of our gweEBP, and seven other visualization methods, on two neural networks, trained for heterogeneous face recognition. The evaluation is performed over two publicly available cross-modality datasets using two evaluation methods termed the “hiding game” and the “inpainting game”. Our experiments showed that the proposed method outperforms the competing methods in both games in most cases. Additionally, our comprehensive study also provides a benchmark for comparing visualization techniques, which may help other researchers develop new techniques and perform comparative studies on them. • We proposed gweEBP for analyzing embedding networks. • Two evaluation protocols were used: the hiding game and the inpainting game. • The inpainting game provided a more reliable metric than the hiding game.
Source: Pattern Recognition Letters
Authors: Yan Wang, Sivapriyaa Kannappan, Fangliang Bai, Stuart Gibson, Christopher Solomon
Institution: University of Kent
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,500
OpenAlex ID: W4409122930