Work

Toward Multimodal Asynchronous Collaboration in VR Artistic Creation with S.P.A.R.K

Year: 2025

Type: conference-paper

Abstract: Recent artistic explorations in VR environments have explored how users engage with virtual spaces, sounds, and bodies whether, as artists, coders, or spectators. While many applications focus primarily on musical interaction or motion capture, few allow users to actively compose spatial and temporal relationships within a multimodal collaborative creation context merging altogether different artistic modalities. In this project, we present a Virtual Reality application that enables novel forms of collaboration between dancers and musicians. The application allows dancers to record full-body performances, which musicians can then use as the basis for sonic composition by spatially mapping sound triggers onto the dancer’s recorded movement. Rather than relying on live capture or real-time gesture tracking, our approach treats movement as a timeline for interaction blending choreography with sound design in an asynchronous workflow. We employ an iterative design process to ensure usability among experts. This paper details the first implementation and study involving 10 participants recruited from professional and amateur artists with electronic music backgrounds, highlighting positive reception of the application’s creative potential and usability.

Source: ACM Symposium on Virtual Reality Software and Technology (VRST)

DOI: 10.1145/3756884.3765998

Authors: Nathan Salin, Valérie Gouranton, Florent Berthaut, Ronan Gaugne