Enhancing dynamic gesture recognition and human–computer interaction through integrated GCN–transformer architecture with transfer learning
Year: 2026
Type: article
Abstract: Dynamic gesture recognition is a core technology for human–computer interaction, yet existing methods face prominent limitations in hand spatial topology modeling, long–short-term temporal feature fusion, and generalization in complex practical scenarios. To tackle these challenges, this paper proposes the TL-BGGT model, which integrates sparse graph convolutional GCN for spatial feature extraction and Transformer for temporal feature fusion, and designs a transfer learning strategy with pre-training and differential fine-tuning to enhance cross-scenario adaptability. Extensive experiments on LAP, MSR Gesture and HaGRID datasets confirm TL-BGGT’s state-of-the-art performance: it achieves 99.06% accuracy on LAP, 82.15% on MSR Gesture (3.3% higher than MEMP Network), and 99.02% on HaGRID, with mAP at 91.35% and 96.94% on LAP and HaGRID, outperforming mainstream baselines. The model also exhibits excellent convergence stability and real-scene generalization, offering a reliable technical support for practical human–computer interaction systems. Finally, its limitations are analyzed, and future directions including multi-modal fusion, domain adaptation optimization, and lightweight design are outlined.
Source: Alexandria Engineering Journal
Authors: Minna Liu, Xinming Guo
Institution: Xianyang Normal University
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $1,900
OpenAlex ID: W7154566525