Work

Visual Information in Semantic Representation

Year: 2010
Type: conference-paper
Abstract: The question of how meaning might be acquired by young children and represented by adult speakers of a language is one of the most debated topics in cognitive science. Existing semantic representation models are primarily amodal based on information provided by the linguistic input despite ample evidence indicating that the cognitive system is also sensitive to perceptual information. In this work we exploit the vast resource of images and associated documents available on the web and develop a model of multimodal meaning representation which is based on the linguistic and visual context. Experimental results show that a closer correspondence to human data can be obtained by taking the visual modality into account. 1
Language: English
Open Access status: green
OpenAlex ID: W155596317
FWCI: 5.796
Cites: 32
Cited by: 124
Related to: 10