Robust computer-vision based construction site detection for assistive-technology applications
Year: 2026
Type: article
Abstract: PURPOSE: Navigating urban environments poses significant challenges for individuals who are blind or have low vision, especially in areas affected by construction. Construction zones introduce hazards such as uneven surfaces, barriers, hazardous materials, excessive noise, and altered routes that obstruct familiar paths and compromise safety. Although navigation tools assist in trip planning, they often overlook these temporary obstacles. Existing hazard detection systems also struggle with the visual variability of construction sites. METHODS: We developed a computer vision-based assistive system integrating three modules: an open-vocabulary object detector to identify diverse construction-related elements, a YOLO-based model specialised in detecting scaffolding and poles, and an optical character recognition module to interpret construction signage. RESULTS: In static testing at seven construction sites using images from multiple stationary viewpoints, the system achieved 88.56% overall accuracy. It consistently identified relevant objects within 2-10 m and at approach angles up to 75°. At 2-4 m, detection was perfect (100%) across all angles. Even at 10 m, six of seven sites remained detectable within a 15° approach. In dynamic testing along a 0.5-mile urban route containing eight construction sites, the system analysed every frame of a first-person walking video. It achieved 87.26% accuracy in distinguishing construction from non-construction areas, rising to 92.0% with a 50-frame majority vote filter. CONCLUSION: The system can reliably detect construction sites in real time and at sufficient distances to provide advance warnings, enabling individuals with visual impairments to make safer mobility decisions, such as proceeding with caution or rerouting.
Institution: New York University
Language: English
Subfield: Occupational Therapy
Field: Health Professions
Domain: Health Sciences
Open Access status: hybrid
Awards: FW-HTF-RL: Collaborative Research: Future expert work in the age of "black box", data-intensive, and algorithmically augmented healthcare, NSF Convergence Accelerator Track H: Smart Wearables for Expanding Workplace Access for People with Blindness and Low Vision, SCC-IRG Track 2: Transportation Gaps and Disability-Related Unemployment: Smarter Cities and Wearables combating Commuting Challenges for the Visually Impaired, G6237623593, NSF Convergence Accelerator Track H: Phase II Smart Wearables for Expanding Workplace Access for People with Blindness and Low Vision, G7661995965
OpenAlex ID: W7127037777
