Work

RealityDrop: A Multimodal Mixed Reality Framework to Manipulate Virtual Content between Cross-system Displays

Year: 2023

Type: preprint

Abstract: In this poster, we present RealityDrop, a novel multimodal framework that uses Mixed Reality (MR) technology to manipulate, display, and transfer virtual content across different display systems. Employing MR as the centre of control, RealityDrop affords concise information dissemination among diverse collaborators, through varied representations that best fit each display system's unique features using `superhuman' gaze and gesture interactions. Three multimodal interaction techniques, a customised content interpreter, and two cross-system interfaces are incorporated for fluent content manipulation and presentation.

Source: arXiv (Cornell University)

DOI: 10.48550/arxiv.2310.07458

Authors: McDade, Jeremy, Jing, Allison, Cunningham, Andrew

Institution: University of South Australia

Language: English

Topic: Interactive and Immersive Displays

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W4387596353

Cites:

Cited by: 1

Related to: 10