Year: 2024
Type: conference-paper
Abstract: In everyday life, humans are confronted with stimuli from multiple sensory modalities which must be associated with, or segregated from each other to form meaningful object-based percepts.A key physical attribute of these stimuli is their spatiotemporal coincidence, especially in the auditory and visual domains.For example, maintaining the synchrony of audio and video streams is one of the main requirements for online conferencing tools.In a previous study, spoken digits (auditory input) were presented with their corresponding graphemes (visual input) at various stimulus onset asynchronies (SOAs).When SOAs were noticeable, the results indicated a tendency to ignore one of the input streams among participants.Consequently, it is assumed that the lack of temporal correspondence between these stimuli reduced the detectability of SOAs and that SOAs were easy to ignore, when detected.Here, we investigate distracting effects of SOAs on verbal serial recall capability using audio-visual speech recordings.The temporal correspondence of these stimuli is increased by the natural cooccurrence of speech and lip movements.Key questions address whether potential stimulus onset asynchrony effects occur with audio-visual speech stimuli and if these effects reflect the perceptual asymmetry of simultaneity judgments.
Authors: L. Vollmer, C.A. Ermert, J. Fels
Institution: RWTH Aachen University
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: bronze
Funder: Deutsche Forschungsgemeinschaft
Awards: Kognitive Leistungen beim Zuhören in komplexen audiovisuellen Kommunikationssituationen mit virtuellen Agenten: Untersuchungen zu Aufmerksamkeit, Erinnerungsleistung und Höranstrengung (exAMPLE), G255747015, GRK 2416: MultiSensesMultiScales: Neue Ansätze zur Aufklärung neuronaler multisensorischer Integration
OpenAlex ID: W4391028348