Work

Learning Latent Representations for Speech Generation and Transformation

Year: 2017
Type: conference-paper
Abstract: An ability to model a generative process and learn a latent representation for speech in an unsupervised fashion will be crucial to process vast quantities of unlabelled speech data. Recently, deep probabilistic generative models such as Variational Autoencoders (VAEs) have achieved tremendous success in modeling natural images. In this paper, we apply a convolutional VAE to model the generative process of natural speech. We derive latent space arithmetic operations to disentangle learned latent representations. We demonstrate the capability of our model to modify the phonetic content or the speaker identity for speech segments using the derived operations, without the need for parallel supervisory data.
Language: English
Open Access status: green
OpenAlex ID: W2605762339
FWCI: 8.185
Cites: 25
Cited by: 170
Related to: 10