Acoustic, neural, and perceptual correlates of polyphonic timbre
Year: 2012
Type: dissertation
Abstract: Alluri, Vinoo Acoustic, Neural, and Perceptual Correlates of Polyphonic Timbre Jyvaskyla: University of Jyvaskyla, 2012, 76 p. (Jyvaskyla Studies in Humanities ISSN 1459-4331; 173) ISBN 978-951-39-4653-1 (nid.) ISBN 978-951-39-4654-8 (PDF) The central focus of the thesis is to investigate timbre perception in a polyphonic context using an interdisciplinary approach that aims at combining the behavioural, acoustic and neural domains. The current work first deals with the gap concerning the connection between monophonic timbre and emotions followed by a thorough investigation of polyphonic timbre perception. The investigation concerning the link between monophonic timbre and emotiondetection revealed that two main dimensions, representing perceived Valence and Energy Arousal sufficiently captured the monophonic timbre affect space. The consistent patterns displayed by the acoustic features suggested that there exist universal perceptual mechanisms in play during affect assessments. With respect to determining the dimensionality of the perceptual polyphonic timbre space, two main dimensions were established, one representing perceived activity and the other representing perceived brightness. Subsequently, spectrotemporal modulations, represented by the new set of acoustic features introduced, the Sub-Band Fluxes, were found to significantly correlate with perceptual ratings. The cross-cultural investigation performed for the sake of generalization of the perceptual dimensions revealed that the dimensionality of the polyphonic timbre space increased from two, representing Activity and Brightness again, to three based on prior exposure via enculturation and musical training. The third dimension, however, did not show any clear pattern although it was found to represent perceived fullness in the case of musicians. The acoustic features displayed similar correlation patterns with the perceptual dimensions across participant groups suggesting common perceptual mechanisms at play. The neural underpinnings of timbre processing were uncovered through a functional magnetic resonance imaging (fMRI) study conducted in a naturalistic setting by using realistic stimuli. Results revealed, in addition to sensory areas, the involvement of cognitive areas of the cerebellum, and default-mode network cerebrocortical areas in timbre processing. Overall, the results lend support to the notion that the perceptual mechanisms involved in the processing of polyphonic timbre dimensions are fairly universal albeit with minor differences and that they highly respond to spectrotemporal modulations or change. Finally, the methodological contributions of this dissertation have potential implications in the field of cognitive neuroscience of music.
Author: Vinoo Alluri
Institution: University of Jyväskylä
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: green
Funder: Jyväskylän Yliopisto
OpenAlex ID: W2204738471
