Work

Human-Computer Synergies in Prosthetic Interactions

Year: 2020

Type: article

Abstract: Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.

Source: Interaction design & architecture(s)/ID&A Interaction design & architecture(s)

DOI: 10.55612/s-5002-044-002

Authors: John M. Carroll, Sooyeon Lee, Madison Reddie, Jordan Beck, Mary Beth Rosson

Institution: Pennsylvania State University

Language: English

Topic: Assistive Technology in Communication and Mobility

Subfield: Occupational Therapy

Field: Health Professions

Domain: Health Sciences

Open Access status: diamond

Funder: National Science Foundation

Award: Collaborative Research: Visual Cortex on Silicon