Work

A Recurrent Variational Autoencoder for Human Motion Synthesis

Year: 2017
Type: conference-paper
Abstract: We propose a novel generative model of human motion that can be trained using a large motion capture dataset, and allows users to produce animations from high-level control signals. As previous architectures struggle to predict motions far into the future due to the inherent ambiguity, we argue that a user-provided control signal is desirable for animators and greatly reduces the predictive error for long sequences. Thus, we formulate a framework which explicitly introduces an encoding of control signals into a variational inference framework trained to learn the manifold of human motion. As part of this framework, we formulate a prior on the latent space, which allows us to generate high-quality motion without providing frames from an existing sequence. We further model the sequential nature of the task by combining samples from a variational approximation to the intractable posterior with the control signal through a recurrent neural network (RNN) that synthesizes the motion. We show that our system can predict the movements of the human body over long horizons more accurately than state-of-the art methods. Finally, the design of our system considers practical use cases and thus provides a competitive approach to motion synthesis.
Language: English
Open Access status: green
OpenAlex ID: W2802441648
FWCI: 6.416
Cites: 18
Cited by: 209
Related to: 10