Work

CCLT: Correction-Conditioned Low-Rank Exchange for Parameter-Efficient RGB-X Tracking

Year: 2026
Type: preprint
Abstract: Parameter-efficient fine-tuning (PEFT) offers a practical way to adapt pretrained RGB trackers to RGB-X tracking, where paired multimodal training data are limited. Despite their architectural diversity, existing PEFT approaches typically fuse the RGB and X branches through two parallel directional corrections. The (X→RGB) correction updates the pre-fusion RGB state using the pre-fusion X state, while the (RGB→X) correction updates the pre-fusion X state using the pre-fusion RGB state. This parallel formulation prevents the (RGB→X) correction from using the corrected RGB state produced by the (X→RGB) correction. However, the source-state dependency between the two directional corrections remains underexplored. To model this source-state dependency under a compact trainable budget, we introduce Correction-Conditioned Low-rank Tracking (CCLT), a parameter-efficient RGB-X tracker that combines sparsely inserted bidirectional Lift exchange (BiLift) modules with lightweight Intra-Stream LoRA (IntraLoRA) adapters. BiLift applies an (X→RGB→X) corrective relay at one selected backbone depth and an (RGB→X→RGB) relay at another, allowing the second directional correction at each depth to read a freshly corrected source state. IntraLoRA reuses low-rank key/value factors across the RGB and X streams to adapt within-stream representations while keeping the shared backbone frozen, thereby balancing cross-modal exchange with parameter-efficient representation adaptation. Together, these innovations enable CCLT to achieve a more favorable balance between tracking performance and computational efficiency than existing state-of-the-art methods across RGB-T, RGB-D and RGB-E tracking tasks.
Language: English
Open Access status: green
OpenAlex ID: W7226017423
Cites: 36
Cited by:
Related to: 10