HaloTouch++: Towards Portable and Condition-Tolerant Surface Touch Input for Mixed Reality
Year: 2026
Type: article
Abstract: Touch interaction on everyday surfaces has long been envisioned as an extension of mixed-reality input, offering tactile feedback and proprioceptive cues that enhance user comfort and precision. However, most existing mixed-reality touch-sensing techniques are designed for static, dry, and large surfaces, making them unsuitable for real-world use where surfaces may be handheld, wet, or smaller in size. We introduce HaloTouch++, a mixed-reality touch input technique that enables low lift-off, water-tolerant and finger profile modified interactions on handheld surfaces. The system harnesses multi-path interference from time-of-flight depth sensing as a stable optical cue for detecting physical contact. A lightweight, plastic reflector attached to the surface amplifies these interference patterns, forming a distinctive “Halo” signature around touch points that remains consistent across surfaces and under varying poses and moisture conditions. In a 15-participant evaluation spanning multiple materials, user poses, and water conditions, HaloTouch++ achieved 97.3% touch-down accuracy and 93.3% gesture recognition accuracy.
DOI: 10.1145/3859336
Institution: University of British Columbia
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Award: G832689143
OpenAlex ID: W7237205175
