Work

Multi-Modal Place Recognition and Pose Estimation for Autonomous Rovers in Unstructured Environments

Year: 2025
Type: dissertation
Abstract: Autonomous navigation in planetary-like environments presents unique challenges due to the absence of GPS signals, limited semantic structure, and visual ambiguity caused by repetitive textures or harsh lighting conditions.Traditional place recognition and localization methods either rely on dense maps and structured environments or only provide coarse retrieval without estimating full 6-DoF (Degrees of Freedom) poses.This limits their applicability in the context of real-time Simultaneous Localization and Mapping (SLAM) for field robotics and planetary exploration.This thesis addresses the problem by developing a multi-modal system that performs both place recognition and relative pose estimation in unstructured, GNSS-denied environments.The proposed approach fuses visual features extracted from a transformer-based encoder (DINOv2) with 3D geometric descriptors from a LiDAR-based backbone (SONATA).These features are projected and aligned in 3D space to produce interpretable correspondences, from which the system estimates full 6D poses.On the retrieval side, DINOv2 descriptors are aggregated using SALAD, a learned VLAD-style module, and searched efficiently using FAISS indexing.The system is evaluated on the Etna volcano dataset, representative of planetary terrains.The results show that the proposed model outperforms established retrieval methods like NetVLAD and TransVPR and achieves more stable pose estimation than handcrafted or regression-based alternatives.The fusion of LiDAR and vision improved robustness in scenes with low texture or poor illumination, validating the hypothesis that multi-modality can bridge the gap between accuracy and generalization.Importantly, the system produces interpretable outputs and operates within real-time constraints for retrieval, although further optimization is needed for pose estimation.This thesis demonstrates that it is feasible to move beyond retrieval-only frameworks and provide full, explainable 6D poses suitable for SLAM.Future work should focus on improving runtime efficiency in the pose estimation module, incorporating more diverse datasets, and testing deployment on real robotic platforms.These developments could contribute to more autonomous and trustworthy robotic systems for exploration, disaster response, and agriculture in extreme environments.
Author: Alejandra Encinar González, Laura
Language: English
Open Access status: green
OpenAlex ID: W7110513446
Cites: 58
Cited by:
Related to: 9