Real-Time Object Detection and Augmented Reality to Support Low-Vision Navigation and Object Localization : A Demonstration
Year: 2026
Type: conference-paper
Abstract: Low-vision (LV) people often face difficulties in navigating complex environments and recognizing objects due to reduced visual acuity, contrast sensitivity, or field of view. In this paper, we present a prototype that combines real-time object detection with augmented reality (AR) visualization to enhance spatial awareness for LV users, supporting safe navigation and object localization in indoor spaces. The system integrates an RGB-D camera and a Microsoft HoloLens 2 headset via ROS and Unity, using a YOLOv11-based perception pipeline to detect and localize static and dynamic objects in 3D and display high-contrast AR icons above the detected objects within the user’s field of view, conveying both their position and identity.
Source: KOPS (University of Konstanz)
Institution: University of Fribourg
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7140227449
FWCI:
Cites:
Cited by:
Related to: