Work

PLY-SLAM: Semantic Visual SLAM Integrating Point–Line Features with YOLOv8-seg in Dynamic Scenes

Year: 2025

Type: article

Abstract: In dynamic and low texture environments, traditional point-feature-based visual SLAM (vSLAM) often faces the challenges of poor robustness and low localization accuracy. To this end, this paper proposes a semantic vSLAM approach that fuses point-line features with YOLOv8-seg. First, we designed a high-performance 3D line-segment extraction method that determines the number of points to be sampled for each line-segment in terms of the length of the 2D line-segments extracted from the image, and back-projects these sampled points combined with the depth image to obtain the 3D point set of the line-segments. On this basis, accurate 3D line-segment fitting is realized in combination with the RANSAC algorithm. Subsequently, we introduce Delaunay triangulation to construct the geometric relationships between map points, detect dynamic feature points by matching changes in the topological structure of feature points in adjacent frames, and combine them with the instance labels provided by the YOLOv8-seg to accurately remove dynamic feature points. Finally, a loop-closure detection mechanism that fuses point-line features with instance-level matching is designed to calculate a normalized similarity score by combining the positional similarity of the instances, the scale similarity, and the spatial consistency of the static instances. A series of simulations and experiments demonstrate the superior performance of our method.

Source: Sensors

DOI: 10.3390/s25123597

Authors: Huan Mao, Jingwen Luo

Institutions: Yunnan Normal University, Yunnan Provincial Department of Education

Language: English

Topic: Robotics and Sensor-Based Localization

Subfield: Aerospace Engineering

Field: Engineering

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $3,137

Funder: National Natural Science Foundation of China