Year: 2026
Type: article
Abstract: How is vision shaped by other senses? Visual cortex is not merely a passive recipient of retinal inputs. It is also responsive to other sensory modalities, particularly audition. While auditory signals have been shown to penetrate early visual cortices, the mechanisms driving these responses remain poorly understood. To examine how audition shapes vision, we used functional MRI to investigate whether audiovisual interactions modulate the gain of responses in human early visual cortices. Specifically, we measured voxel-wise contrast-response functions (CRF), while participants viewed horizontally drifting gratings paired with auditory motion that was directionally congruent or incongruent with the visual motion, or stationary. We show that congruent audiovisual motion enhances voxel-wise contrast sensitivity whereas incongruent motion reduces it, manifesting as a robust contrast gain modulation across areas V1–V3. This direction-selective enhancement is nicely captured by a divisive normalization model incorporating auditory-driven feedback modulation. Our findings provide compelling evidence for cross-modal interactions at early stages of visual processing, driven by contrast gain modulation –a bidirectional modulation in sensitivity that maintains the balance between local excitatory and inhibitory activity. Together, these results reveal that audiovisual interactions can alter a cornerstone property of vision, highlighting the dynamic role of early visual cortex in multisensory processing.
Source: Communications Biology
Authors: Minsun Park, Sam Ling
Institution: Boston University
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $4,190
OpenAlex ID: W7212197958
FWCI:
Cites:
Cited by:
Related to: