Work

Are we ready to tackle perceptual segmentation of natural scenes?

Year: 2025

Type: article

Abstract: • Segmentation is fundamental to perceptual organization but poorly understood for natural stimuli. • Limitations of classical experimental methods and computer vision databases are discussed. • New measurements and algorithms for segmentation of natural images are highlighted. • Progress hinges on paradigms that integrate those computational and experimental innovations. • Recent studies that exemplify encouraging initial steps towards this goal are reviewed. Processes of perceptual segmentation and integration (PSI) are fundamental to perceptual organization. Although PSI of visual stimuli has been studied for over a century, we have only a rudimentary understanding of PSI of natural visual stimuli. This is due to limitations of traditional experimental methods in visual psychophysics of PSI; to the exclusive focus of computer-vision research for image segmentation on performance benchmarks; and to the scarcity of meaningful interactions between those two communities. The recent literature discussed in this paper presents a compelling argument that the field is starting to overcome those barriers. One important example of such an interaction between visual psychophysics and machine learning is given by the literature on the crowding phenomenon, which calls for revised models of summary statistics to explain some uncrowding results. Other examples reviewed here include studies of the perceptual uncertainty and dynamics of segmentation of natural stimuli, which call for computational models with probabilistic representations and dynamic computations. Conversely, contemporary machine learning algorithms produce impressive segmentation maps that still need to be aligned with human maps as measured with objective tasks such as the same/different segment paradigm reviewed here. Therefore, the time is ripe to move vision science forward by bridging new computational and experimental paradigms for PSI of natural stimuli.

Source: Vision Research

DOI: 10.1016/j.visres.2025.108749

Authors: Ruben Coen-Cagli, Pascal Mamassian

Institutions: Albert Einstein College of Medicine, Centre National de la Recherche Scientifique, Université Paris Sciences et Lettres, École Normale Supérieure - PSL, Laboratoire des Systèmes Perceptifs

Language: English

Topic: Visual perception and processing mechanisms

Subfield: Cognitive Neuroscience

Field: Neuroscience

Domain: Life Sciences

Open Access status: hybrid

Estimated APC paid: $2,940