Movement Sonification During Haptic Exploration Shifts Emotional Outcome Without Altering Texture Perception
Year: 2025
Type: article
Abstract: BACKGROUND: Adding movement sonification to haptic exploration can change the perceptual outcome of a textured surface through multisensory processing. We hypothesized that auditory-evoked emotions influence the appraisal of textured surfaces, with corresponding changes reflected in cortical excitability. METHODS: Twelve participants actively rubbed two different textured surfaces (slippery and rough) either without movement sonification, or with pleasant or disagreeable movement sonification. RESULTS AND DISCUSSION: We found that sounds, whether agreeable or disagreeable, did not change the texture appraisal. However, the less pleasant surface was associated with a stronger negative hedonic valence, particularly when paired with disagreeable movement sonification. Time frequency analyses of electroencephalography (EEG) activities revealed a significant reduction in beta-band power [15-25 Hz] within the source-estimated sensorimotor and superior posterior parietal cortices when contrasting both pleasant and unpleasant sounds with the silent touch. This suggests that the primary somatosensory cortices together with the superior parietal regions participated in the audio-tactile binding, with both pleasant and unpleasant sounds. In addition, we observed a significant increase in beta-band power in medial visual areas, specifically when disagreeable movement sonification was paired with tactile exploration. This may reflect a disengagement of visual cortical processing, potentially amplifying auditory-driven emotional responses and intensifying the perceived unpleasantness of the explored surfaces. CONCLUSION: Our results offer new insights into the neural mechanisms by which hedonic valence of auditory signals modulates emotional processing, without disrupting the perceptual analysis of texture properties.
DOI: 10.31083/jin43841
Institutions: Centre National de la Recherche Scientifique, Institut Universitaire de France, Aix-Marseille Université, Centre de Recherche en Psychologie et Neurosciences, Franche-Comté Électronique Mécanique Thermique et Optique - Sciences et Technologies, Université Marie et Louis Pasteur, Mines Saint-Étienne, Université de Bourgogne, Laboratoire d'étude de l'apprentissage et du développement, Département de Recherche en Ingénierie des Véhicules pour l'Environnement, Sapienza University of Rome, Laboratoire de Mécanique des Contacts et des Structures, Institut National des Sciences Appliquées de Lyon, Laboratoire Cognition, Langues, Langage, Ergonomie, Université de Toulouse
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $1,900
Funder: Agence Nationale de la Recherche
OpenAlex ID: W4415991393