Year: 2014
Type: conference-paper
Abstract: We investigate the order of mention for objects in relational descriptions in visual scenes.Existing work in the visual domain focuses on content selection for text generation and relies primarily on templates to generate surface realizations from underlying content choices.In contrast, we seek to clarify the influence of visual perception on the linguistic form (as opposed to the content) of descriptions, modeling the variation in and constraints on the surface orderings in a description.We find previously-unknown effects of the visual characteristics of objects; specifically, when a relational description involves a visually salient object, that object is more likely to be mentioned first.We conduct a detailed analysis of these patterns using logistic regression, and also train and evaluate a classifier.Our methods yield significant improvement in classification accuracy over a naive baseline.
DOI: 10.3115/v1/e14-1055
Authors: Micha Elsner, Hannah Rohde, Alasdair Clarke
Institutions: The Ohio State University, University of Edinburgh
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W2250185474