Work

Understanding videos, constructing plots learning a visually grounded storyline model from annotated videos

Year: 2009
Type: conference-paper
Abstract: Analyzing videos of human activities involves not only recognizing actions (typically based on their appearances), but also determining the story/plot of the video. The storyline of a video describes causal relationships between actions. Beyond recognition of individual actions, discovering causal relationships helps to better understand the semantic meaning of the activities. We present an approach to learn a visually grounded storyline model of videos directly from weakly labeled data. The storyline model is represented as an AND-OR graph, a structure that can compactly encode storyline variation across videos. The edges in the AND-OR graph correspond to causal relationships which are represented in terms of spatio-temporal constraints. We formulate an Integer Programming framework for action recognition and storyline extraction using the storyline model and visual groundings learned from training data.
Authors: Abhinav Gupta, Praveen Srinivasan, Jianbo Shi, Larry S. Davis
Language: English
Open Access status: green
OpenAlex ID: W2139117248
FWCI: 16.72
Cites: 33
Cited by: 236
Related to: 10