Work

HaloTouch++: Towards Portable and Condition-Tolerant Surface Touch Input for Mixed Reality

Year: 2026
Type: article
Abstract: Touch interaction on everyday surfaces has long been envisioned as an extension of mixed-reality input, offering tactile feedback and proprioceptive cues that enhance user comfort and precision. However, most existing mixed-reality touch-sensing techniques are designed for static, dry, and large surfaces, making them unsuitable for real-world use where surfaces may be handheld, wet, or smaller in size. We introduce HaloTouch++, a mixed-reality touch input technique that enables low lift-off, water-tolerant and finger profile modified interactions on handheld surfaces. The system harnesses multi-path interference from time-of-flight depth sensing as a stable optical cue for detecting physical contact. A lightweight, plastic reflector attached to the surface amplifies these interference patterns, forming a distinctive “Halo” signature around touch points that remains consistent across surfaces and under varying poses and moisture conditions. In a 15-participant evaluation spanning multiple materials, user poses, and water conditions, HaloTouch++ achieved 97.3% touch-down accuracy and 93.3% gesture recognition accuracy.
Language: English
Open Access status: hybrid
Award: G832689143
OpenAlex ID: W7237205175
FWCI:
Cites: 63
Cited by:
Related to: 10