Research on the Application of Voice Emotion Recognition in Games Based on Deep Learning
Year: 2025
Type: article
Abstract: In order to improve the level of voice emotion recognition in games, this study proposes a model that combines a multi-head attention mechanism with a two-dimensional convolutional neural network (2D-CNN) and a Transformer unit. Experiments on the model on the CASIA emotion datasets show that Mel-frequency cepstral coefficients (MFCCs) are one of the key voice emotion features, and the recognition ability is further enhanced when they are combined with other features. Data augmentation techniques were used to significantly improve recognition accuracy, The weighted accuracy reached 90.83%, the precision was 90.76%, and the recall was 90.00%, which were 2.30%, 1.56%, and 3.12% higher than the traditional CNN-LSTM model, respectively. The key is that the attention mechanism can accurately focus on important emotion-related features in voice signals, filter out irrelevant noise, and thus accurately distinguish similar emotions. This model can use the Valence-Arousal emotional space to perceive the players voice emotions in real time, optimize game interactions, enhance game immersion, and provide reliable emotion perception technology.
Authors: Yun-Rui Ge, Dong-Min Cho
Language: English
Topic: Emotion and Mood Recognition
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: diamond
OpenAlex ID: W4415979126
FWCI:
Cites:
Cited by:
Related to: