Learning Spatial Interest Regions from Videos to Inform Action Recognition in Still Images
Year: 2014
Type: article
Abstract: . Common approaches to human action recognition from im-ages rely on local descriptors for classification. Typically, these descrip-tors are computed in the vicinity of key points which either result from running a key point detector or from dense or random sampling of pixel coordinates. Such key points are not a-priori related to human activi-ties and thus of limited information with regard to action recognition. In this paper, we propose to identify action-specific key points in images using information available from videos. Our approach does not require manual segmentation or templates but applies non-negative matrix fac-torization to optical flow fields extracted from videos. The resulting basis flows are found to to be indicative of action specific image regions and therefore allow for an informed sampling of key points. We also present a generative model that allows for characterizing joint distributions of regions of interest and a human actions. In practical experiments, we determine correspondences between regions of interest that were auto-matically learned from videos and manually annotated locations of hu-man body parts available from independent benchmark image data sets. We observe high correlations between learned interest regions and body parts most relevant for different actions.
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2293021075