Eye’m talking to you: speakers’ gaze direction modulates co-speech gesture processing in the right MTG
Year: 2014
Type: article
Abstract: Recipients process information from speech and co-speech gestures, but it is currently unknown how this processing is influenced by the presence of other important social cues, especially gaze direction, a marker of communicative intent. Such cues may modulate neural activity in regions associated either with the processing of ostensive cues, such as eye gaze, or with the processing of semantic information, provided by speech and gesture. Participants were scanned (fMRI) while taking part in triadic communication involving two recipients and a speaker. The speaker uttered sentences that were and were not accompanied by complementary iconic gestures. Crucially, the speaker alternated her gaze direction, thus creating two recipient roles: addressed (direct gaze) vs unaddressed (averted gaze) recipient. The comprehension of Speech&Gesture relative to SpeechOnly utterances recruited middle occipital, middle temporal and inferior frontal gyri, bilaterally. The calcarine sulcus and posterior cingulate cortex were sensitive to differences between direct and averted gaze. Most importantly, Speech&Gesture utterances, but not SpeechOnly utterances, produced additional activity in the right middle temporal gyrus when participants were addressed. Marking communicative intent with gaze direction modulates the processing of speech-gesture utterances in cerebral areas typically associated with the semantic processing of multi-modal communicative acts.
DOI: 10.1093/scan/nsu047
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: hybrid
Estimated APC paid: $2,379
Awards: Raising glasses and pointing fingers: A neurocognitive account of communicative actions, Language in our hand: The role of modality in shaping spatial language development in deaf and hearing children, From action to communication: the role of intention and social cues in the perception of gestures as communicative acts, The Interaction Engine: Interactive foundations for communication
OpenAlex ID: W2165271834
