Work

ES-ATRK: A Global Bundle Adjustment Initialisation Method for Event-Based Stereo Visual Inertial SLAM System Using Adaptive Threshold Robust Kernel Functions

Year: 2026

Type: article

Abstract: To address the issues of insufficient robustness, large depth recovery errors, and poor scene adaptability currently present in the initialisation phase of event-based stereo visual inertial SLAM systems, we propose a global BA initialisation method based on an adaptive threshold robust kernel function, ES-ATRK. The algorithm first achieves spatio-temporal fusion of events and visual features. Event features are triangulated to obtain depth values that serve as the 3D map, whilst visual features provide 2D observations; both modalities jointly feed the Structure from Motion (SfM) pipeline, laying the foundation for global bundle adjustment (BA) optimisation. The core contribution lies in incorporating a robust kernel function into the global BA to suppress outlier interference and in designing an adaptive thresholding algorithm that dynamically determines the kernel threshold. Furthermore, the algorithm calculates an initial threshold based on the quantile distribution of residuals prior to BA optimisation, combined with validity checks and a multi-round iterative smoothing adjustment strategy, thereby achieving scene-adaptive thresholding. In over 85% of the test scenes on the VECtor dataset, its localisation accuracy improved by at least 10% compared to existing mainstream event-based SLAM methods, such as ESVIO and USLAM. In high-dynamic scenes, its ATE performance is approximately twice that of mainstream models such as ESIO, and it maintains excellent positioning accuracy and stability of three-axis errors in generalisation tests on the HKU and MVSEC datasets. Furthermore, in the large-scale outdoor testing scenarios of the DSEC dataset, ES-ATRK also demonstrates superior feature tracking and trajectory estimation performance. This method effectively enhances the robustness of initialisation and depth recovery performance in event-based stereo visual inertial SLAM systems, reduces overall positioning error, and offers greater adaptability in challenging scenarios such as low-texture, high-dynamic, and HDR environments.

Source: Sensors

DOI: 10.3390/s26103014