Work

LookUP: Command Search Using Dwell-free Eye Typing in Mixed Reality

Year: 2024

Type: conference-paper

Abstract: We introduce LookUP, a novel general purpose command search system for mixed reality headsets, offering a hands-free experience through dwell-free eye typing. With LookUP, users can trigger the display of a virtual keyboard with a simple upward head motion. The keyboard then uses a statistical decoder to interpret users’ intended text based on their eye movements. This approach diverges from traditional dwell-time methods, significantly enhancing typing speed and efficiency. Our research involved deploying LookUP on a HoloLens 2, and benchmarking it against a dwell-based command search baseline and the native HoloLens system menu. Our user study indicated that participants spent a significantly shorter time using LookUP with dwell-free eye typing in command search and entry, demonstrating LookUP’s potential to be a complementary command input for mixed reality headsets.

Source: IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

DOI: 10.1109/ismar62088.2024.00114

Authors: Jinghui Hu, John J. Dudley, Per Ola Kristensson

Institution: University of Cambridge

Language: English

Topic: Gaze Tracking and Assistive Technology

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: Engineering and Physical Sciences Research Council

Awards: Towards an Equitable Social VR, Inclusive Design of Immersive Content