Work

Semantic-Topological Cognitive Maps for Assistive Indoor Navigation of a Robot Partner

Year: 2026
Type: article
Abstract: Assistive indoor mobile robots are increasingly expected to connect natural-language requests about familiar places and objects with the metric maps used for localization and motion planning. Metric simultaneous localization and mapping (SLAM) supports reliable geometry and collision avoidance, whereas many open-vocabulary scene-graph systems remain separated from the navigation stacks used on deployed robots. This paper presents a semantic-topological cognitive map (STCM) that bridges these representations for assistive navigation. The system derives place nodes from a LiDAR–inertial pose stream through a dual growing neural gas backend and consolidates object instances over time. GroundingDINO and MobileSAM provide open-vocabulary semantic grounding in the map frame through LiDAR–image association and temporal score fusion. A tool-mediated large language model interface maps user commands to explicit STCM nodes, while graph search and ROS 2 Navigation2 (Nav2) remain responsible for path computation and execution. Evaluation with recorded robot sessions, an outdoor distribution-shift probe, and a public indoor-scene benchmark indicates that the STCM backend improves object-graph construction and that the language interface improves functional-command grounding when requested objects are recoverable by perception. The pipeline is demonstrated on a Ranger Garden Assistant platform with FAST-LIO2 mapping, incremental graph construction during the mapping pass, and waypoint execution from a serialized map artifact.
Language: English
Open Access status: diamond
OpenAlex ID: W7236790716
FWCI:
Cites: 57
Cited by:
Related to: 10