A Spatiotemporal Perspective on Dynamical Computation in Neural Information Processing Systems
Year: 2024
Type: preprint
Abstract: Spatiotemporal flows of neural activity, such as traveling waves, have been observed throughout the brain since the earliest recordings; yet there is still little consensus on their functional role. Recent experiments and models have linked traveling waves to visual and physical motion, but these observations have been difficult to reconcile with standard accounts of topographically organized selectivity and feedforward receptive fields. Here, we introduce a theoretical framework that formalizes and generalizes the connection between 'motion' and flowing neural dynamics in the language of equivariant neural network theory. We consider 'motion' not only in physical or visual spaces, but also in more abstract representational spaces, and we argue that recurrent traveling-wave-like dynamics are not just useful but necessary for accurate and stable processing of any signal undergoing such motion. Formally, we show that for any non-trivial recurrent neural network to process a sequence undergoing a flow transformation (such as visual motion) in a structured equivariant manner, its hidden state dynamics must actively realize a homomorphic representation of the same flow through recurrent connectivity. In this "spatiotemporal perspective on dynamical computation", traveling waves and related flows are best understood as faithful dynamic representations of stimulus flows; and consequently the natural inclination of biological systems towards such dynamics may be viewed as an innate inductive bias towards efficiency and generalization in the spatiotemporally-structured dynamical world they inhabit.
Source: PubMed Central
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: green
Funders: National Science Foundation, Harvard University, Canada First Research Excellence Fund, National Institutes of Health, Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Office of Naval Research, National Institute of Mental Health, National Eye Institute, National Institute of Neurological Disorders and Stroke
Awards: G4045788911, DDALAB: Identifying Latent States from Neural Recordings with Nonlinear Causal Analysis, NEURONEX: The fabric of the primate neocortex and the origin of mental representations. From transcriptomics to single neurons and neuronal networks., G8876996369, Spatiotemporal patterns of neural activity and their role in perception, Traveling Waves in Neocortical Circuits: Mechanisms, Computational Roles in Sensory Processing, and Impact on Sensory Perception
OpenAlex ID: W4403780034
