Work

Adversarially Robust Multimodal Biometric Authentication Using a Hybrid Vision Transformer-DenseNet Face–Ear Fusion Network

Year: 2026
Type: article
Abstract: This study proposes the Adversarially Robust Hybrid Vision Transformer-DenseNet Fusion (AR-HViTDF) network for sequential face–ear biometric authentication. Despite the increase in security through sequential authentication of modalities, deep architectures are still prone to adversarial perturbations that can change the authentication result through subtle perturbations. The lightweight DenseNet branch learns the finer local texture features, while a compact Vision Transformer (ViT) branch learns the long-distance global structural information. Subsequently, a multi-head cross-attention fusion module is used to learn the interaction between the two branches such that each modality learns from the other. A reinforcement learning (RL)-based agent is employed to adapt the decision threshold exclusively at the decision layer level. The entire system is robustified with projected gradient descent (PGD) adversarial training in addition to a TRADES-style robustness regularizer. Using 5-fold subject-disjoint cross-validation, our approach obtains a clean accuracy of 98.12 ± 0.41%, along with an equal error rate (EER) of 0.71%. Under a PGD-20 attack with ϵ=4/255, the proposed model retains an accuracy of 90.1%, compared with the standard DenseNet baseline. The sequential authentication reduces the false acceptance rate (FAR) by almost 27% compared with the concatenation approach. Cross-dataset experiments further assess the transferability of the learned representations across datasets and acquisition conditions. Differences among the cumulative ablation configurations are assessed using repeated-measures analysis of variance.
Source: Mathematics
Language: English
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W7236162185
FWCI:
Cites: 33
Cited by:
Related to: 10