Work

Head-controlled perception via electro-neural stimulation

Year: 2012
Type: dissertation
Abstract: This thesis explores the use of head-mounted sensors combined with haptic feedback for providing effective and intuitive perception of the surrounding environment for the visually impaired. Additionally, this interaction paradigm is extended to providing haptic perception of graphical computer interfaces. To achieve this, accurate sensing of the head itself is required for tracking the user's "gaze" position instead of sensing the environment. Transcutaneous electro-neural feedback is utilised as a substitute for the retina's neural input, and is shown to provide a rich and versatile communication interface without encumbering the user's auditory perception.\nSystems are presented for:\nfacilitating obstacle avoidance and localisation via electro-neural stimulation of intensity proportional to distance (obtained via head-mounted stereo cameras or infrared range sensors);\nencoding of colour information (obtained via a head-mounted video camera or dedicated colour sensor) for landmark identification using electro-neural frequency;\nnavigation using GPS data by encoding landmark identifiers into short pulse patterns and mapping fingers/sensors to bearing regions (aided by a head-mounted digital compass);\ntracking human head-pose using a single video camera with accuracy within 0.5degrees;\nutilising time-of-flight sensing technology for head-pose tracking and facial recognition;\nnon-visual manipulation of a typical software "desktop" graphical user interface using point-and-click and drag-and-drop interactions;\nand haptic perception of the spatial layout of pages on the World Wide Web, contrasting output via electro-neural stimulation and Braille displays.\nPreliminary experimental results are presented for each system. References to many new research endeavours building upon the concepts pioneered in this project are also provided.
Author: Simon Meers
Language: English
Open Access status: green
OpenAlex ID: W65069317
Cites: 76
Cited by:
Related to: 10