Work

Impulse Processing: A Dynamical Systems Model of Incremental Eye Movements in the Visual World Paradigm

Year: 2011

Type: article

Abstract: The Visual World Paradigm (VWP) presents listeners with a challenging problem: They must integrate two disparate signals, the spoken language and the visual context, in support of action (e.g., complex movements of the eyes across a scene). We present Impulse Processing, a dynamical systems approach to incremental eye movements in the visual world that suggests a framework for integrating language, vision, and action generally. Our approach assumes that impulses driven by the language and the visual context impinge minutely on a dynamical landscape of attractors corresponding to the potential eye-movement behaviors of the system. We test three unique predictions of our approach in an empirical study in the VWP, and describe an implementation in an artificial neural network. We discuss the Impulse Processing framework in relation to other models of the VWP.

Source: Cognitive Science

DOI: 10.1111/j.1551-6709.2011.01180.x

Authors: Anuenue Kukona, Whitney Tabor

Institutions: Haskins Laboratories, University of Connecticut

Language: English

Topic: Neurobiology of Language and Bilingualism

Subfield: Cognitive Neuroscience

Field: Neuroscience

Domain: Life Sciences

Open Access status: green

Funder: Eunice Kennedy Shriver National Institute of Child Health and Human Development

Awards: Self-Organized Sentence Processing and Reading Ability, Neurobehavioral Mechanisms in Reading Comprehension