Work

Reconstruction of the Complete Vocal Tract Contour Through Acoustic to Articulatory Inversion Using Real-Time MRI Data

Year: 2025

Type: conference-paper

Abstract: Acoustic to articulatory inversion has often been limited to a small part of the vocal tract because the data are generally EMA (ElectroMagnetic Articulography) data requiring sensors to be glued to easily accessible articulators. The presented acoustic to articulation model focuses on the inversion of the entire vocal tract from the glottis, the complete tongue, the velum, to the lips. It relies on a realtime dynamic MRI database of more than 3 hours of speech. The data are the denoised speech signal and the automatically segmented articulator contours. Several bidirectional LSTM-based approaches have been used, either inverting each articulator individually or inverting all articulators simultaneously. To our knowledge, this is the first complete inversion of the vocal tract. The average RMSE precision on the test set is 1.65 mm to be compared with the pixel size which is 1.62 mm.

Source: Interspeech (USB)

DOI: 10.21437/interspeech.2025-963

Authors: Sofiane Azzouz, Pierre-André Vuissoz, Yves Laprie

Institutions: Centre Inria de l'Université de Lorraine, MULTISPEECH: La parole multimodale en interaction, Centre Hospitalier Régional et Universitaire de Nancy, Imagerie Adaptative Diagnostique et Interventionnelle, Université de Lorraine

Language: English

Topic: Phonetics and Phonology Research

Subfield: Experimental and Cognitive Psychology

Field: Psychology

Domain: Social Sciences

Open Access status: green

Funder: Agence Nationale de la Recherche

Award: Fully 3D talking head with aero-acoustic simulations