UltraArUco: A Lightweight Multilingual Library And Framework With Low-Latency Real-Time Marker-Based Tracking System For Mobile AR Interaction
Year: 2026
Type: preprint
Abstract: UltraArUco is a lightweight multilingual library and framework for low latency, realtime marker-based tracking in mobile augmented reality. Unlike standard OpenCV-based implementations, UltraArUco introduces an optimized multilingual wrapper that reduces per-frame latency in six times, while maintaining high accuracy. Distributed Wi-Fi architecture provides portability, connects a mobile device (camera input) with a PC-based visual application, enabling responsive interactions. The framework is validated through an interactive piano simulation, where static ArUco markers on keys enable occlusion based note triggering, and hand-mounted markers provide spatial gesture recognition. UltraArUco's system requirements make it highly suitable for resource-constrained mobile AR applications, demonstrating a viable AR music application without specialized equipment.
Source: arXiv (Cornell University)
Institution: Skolkovo Institute of Science and Technology
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: Russian Science Foundation
Award: G2841149998
OpenAlex ID: W7203598144
