Work

Cross Lingual Cross Corpus Speech Emotion Recognition

Year: 2020
Type: preprint
Abstract: The majority of existing speech emotion recognition models are trained and evaluated on a single corpus and a single language setting. These systems do not perform as well when applied in a cross-corpus and cross-language scenario. This paper presents results for speech emotion recognition for 4 languages in both single corpus and cross corpus setting. Additionally, since multi-task learning (MTL) with gender, naturalness and arousal as auxiliary tasks has shown to enhance the generalisation capabilities of the emotion models, this paper introduces language ID as another auxiliary task in MTL framework to explore the role of spoken language on emotion recognition which has not been studied yet.
Institution: Columbia University
Language: English
Field: Psychology
Open Access status: green
OpenAlex ID: W3012473796
Cites: 24
Cited by: 15
Related to: 10