Work

Datamancer: Bimanual Gesture Interaction in Multi-Display Ubiquitous Analytics Environments

Year: 2025

Type: conference-paper

Abstract: We introduce Datamancer, a wearable device enabling bimanual gesture interaction across multi-display ubiquitous analytics environments. Datamancer addresses the gap in gesture-based interaction within data visualization settings, where current methods are often constrained by limited interaction spaces or the need for installing bulky tracking setups. Datamancer integrates a finger-mounted pinhole camera and a chest-mounted gesture sensor, allowing seamless selection and manipulation of visualizations on distributed displays. By pointing to a display, users can acquire the display and engage in various interactions, such as panning, zooming, and selection, using both hands. Our contributions include (1) an investigation of the design space of gestural interaction for physical ubiquitous analytics environments; (2) a prototype implementation of the Datamancer system that realizes this model; and (3) an evaluation of the prototype through demonstration of application scenarios, an expert review, and a user study.

Source: CHI Conference on Human Factors in Computing Systems

DOI: 10.1145/3706598.3713123

Authors: Biswaksen Patnaik, Marcel Borowski, Huaishu Peng, Clemens Nylandsted Klokmose, Niklas Elmqvist

Institutions: University of Maryland, College Park, Aarhus University

Language: English

Topic: Interactive and Immersive Displays

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funder: Villum Fonden

Award: G3077918671