MSTFT: Mamba-Based Spatio-Temporal Fusion for Small Object Tracking in UAV Videos
Year: 2026
Type: article
Abstract: Unmanned Aerial Vehicle (UAV) visual tracking is widely used but continues to face challenges such as unpredictable target motion, error accumulation, and the sparse appearance of small targets. To address these issues, we propose a Mamba-based Spatio-Temporal Fusion Tracker. To address tracking drift from large displacements and abrupt pose changes, we first introduce a Bidirectional Spatio-Temporal Mamba module. It employs bidirectional spatial scanning to capture discriminative local features and temporal scanning to model dynamic motion patterns. Second, to suppress error accumulation in complex scenes, we develop a Dynamic Template Fusion module with Adaptive Attention. This module integrates a threefold safety verification mechanism—based on response peak, temporal consistency, and motion stability—with a scale-aware strategy to enable robust template updates. Moreover, we design a Small-Target-Aware Context Prediction Head that utilizes a Gaussian-weighted prior to guide feature fusion and refines the loss function, significantly improving localization accuracy under sparse target features and strong background interference. On three major UAV tracking benchmarks (UAV123, UAV123@10fps, and UAV20L), our MSTFT establishes new state-of-the-art with success AUCs of 79.4%, 76.5%, and 75.8% respectively. More importantly, it maintains a tracking speed of 45 FPS, demonstrating a superior balance between precision and efficiency.
Source: Electronics
Institution: Lanzhou University of Technology
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,896
OpenAlex ID: W7119092077
FWCI:
Cites:
Cited by:
Related to: