Work

Natural cross-modal mappings between visual and auditory features

Year: 2010

Type: article

Abstract: The brain may combine information from different sense modalities to enhance the speed and accuracy of detection of objects and events, and the choice of appropriate responses. There is mounting evidence that perceptual experiences that appear to be modality-specific are also influenced by activity from other sensory modalities, even in the absence of awareness of this interaction. In a series of speeded classification tasks, we found spontaneous mappings between the auditory feature of pitch and the visual features of vertical location, size, and spatial frequency but not contrast. By dissociating the task variables from the features that were cross-modally related, we find that the interactions happen in an automatic fashion and are possibly located at the perceptual level.

Source: Journal of Vision

DOI: 10.1167/10.1.6

Authors: K. K. Evans, A. Treisman

Institutions: Brigham and Women's Hospital, Harvard University, Princeton University

Language: English

Topic: Multisensory perception and integration

Subfield: Experimental and Cognitive Psychology

Field: Psychology

Domain: Social Sciences

Open Access status: gold

Estimated APC paid: $1,850

Funders: National Institute of Mental Health, National Eye Institute