Work

A multimodal probabilistic model for gesture--based control of sound synthesis

Year: 2013

Type: conference-paper

Abstract: In this paper, we propose a multimodal approach to create the mapping between gesture and sound in interactive music systems. Specifically, we propose to use a multimodal HMM to conjointly model the gesture and sound parameters. Our approach is compatible with a learning method that allows users to define the gesture--sound relationships interactively. We describe an implementation of this method for the control of physical modeling sound synthesis. Our model is promising to capture expressive gesture variations while guaranteeing a consistent relationship between gesture and sound.

Source: ACM International Conference on Multimedia (ACM MM)

DOI: 10.1145/2502081.2502184

Authors: Jules Françoise, Norbert Schnell, Frédéric Bevilacqua

Institutions: Centre National de la Recherche Scientifique, Institut de Recherche et Coordination Acoustique Musique, Université Pierre-et-Marie-Curie

Language: English

Topic: Music Technology and Sound Studies

Subfield: Music

Field: Arts and Humanities

Domain: Social Sciences

Open Access status: green

Funder: Agence Nationale de la Recherche

Award: Evaluation of the sensorimotor learning in gesture-sound interactive systems