Work

Sequential adaptation framework for efficient detection and adaptive tracking of vulnerable road users in real-world scenarios

Year: 2026
Type: article
Abstract: Vulnerable Road Users (VRUs), including pedestrians and cyclists, require reliable detection and tracking for intelligent transportation systems. This study presents a YOLOv8-Dynamic-SORT framework that combines accurate VRU detection, gradient-based sequential adaptation, and adaptive multi-object tracking. A comparative evaluation of Faster R-CNN, YOLOv5, YOLOv7, and YOLOv8 variants identifies YOLOv8x as the detector offering the most favorable accuracy-latency trade-off, achieving a precision of 0.763, a recall of 0.485, an [email protected] of 0.541, and an F1-score of 0.593 at an inference latency of 9.9 ms per image. Faster R-CNN attains a higher recall (0.670) and F1-score (0.604) but requires 220 ms per image, which precludes real-time onboard deployment. To examine adaptation across domains, the VisDrone-trained detector is sequentially adapted to the Caltech Pedestrian dataset and the effect of the optimizer on knowledge retention is quantified on the original task. SGD-based adaptation reduces the forgetting measure on VisDrone2019 from $$0.097 \pm 0.007$$ (Adam) to $$0.021 \pm 0.003$$ and improves backward transfer from $$-\,0.097 \pm 0.007$$ to $$-\,0.021 \pm 0.003$$ , retaining a VisDrone [email protected] of $$0.519 \pm 0.008$$ after adaptation, while also reaching a higher Caltech [email protected] of $$0.608 \pm 0.03$$ compared with $$0.461 \pm 0.03$$ for Adam adaptation. For tracking, the proposed Dynamic-SORT module selects among five BoxMOT trackers at runtime according to measurable scene descriptors. Compared with the best fixed configuration (BoTSORT: HOTA 47.8, MOTA 68.9, IDF1 78.9), Dynamic-SORT attains HOTA 48.6, MOTA 69.4, and IDF1 80.1 at an additional decision overhead of 1.8 ms, while achieving an end-to-end throughput of 48 FPS. These results indicate that optimizer choice measurably affects knowledge retention during sequential adaptation, and that scene-conditioned tracker selection improves identity preservation at modest computational cost.
Language: English
Open Access status: gold
Estimated APC paid: $1,590
OpenAlex ID: W7235448970
FWCI:
Cites: 38
Cited by:
Related to: 10