Image and Vision Computing, ( ISI ), Volume (90), No (10), Year (2019-10) , Pages (103805-103805)

Title : ( A component-based video content representation for action recognition )

Authors: Vida Adeli Mosabbeb , Ehsan Fazl-Ersi , Ahad Harati ,

Access to full-text not allowed by authors

Citation: BibTeX | EndNote


This paper investigates the challenging problem of action recognition in videos and proposes a new component-based approach for video content representation. Although satisfactory performance for action recognition has already been obtained for certain scenarios, many of the existing solutions require fully-annotated video datasets in which region of the activity in each frame is specified by a bounding box. Another group of methods require auxiliary techniques to extract human-related areas in the video frames before being able to accurately recognize actions. In this paper, a Weakly-Supervised Learning (WSL) framework is introduced that eliminates the need for per-frame annotations and learns video representations that improve recognition accuracy and also highlights the activity related regions within each frame. To this end, two new representation ideas are proposed, one focus on representing the main components of an action, i.e. actionness regions, and the other focus on encoding the background context to represent general and holistic cues. A three-stream CNN is developed, which takes the two proposed representations and combines them with a motion-encoding stream. Temporal cues in each of the three different streams are modeled through LSTM, and finally fully-connected neural network layers are used to fuse various streams and produce the final video representation. Experimental results on four challenging datasets, demonstrate that the proposed Component-based Multi-stream CNN model (CM-CNN), trained on a WSL setting, outperforms the state-of-the-art in action recognition, even the fully-supervised approaches.


, Actionness likelihood Action recognition Action components LSTM Three, stream convolutional neural network
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

author = {Adeli Mosabbeb, Vida and Fazl-Ersi, Ehsan and Harati, Ahad},
title = {A component-based video content representation for action recognition},
journal = {Image and Vision Computing},
year = {2019},
volume = {90},
number = {10},
month = {October},
issn = {0262-8856},
pages = {103805--103805},
numpages = {0},
keywords = {Actionness likelihood Action recognition Action components LSTM Three-stream convolutional neural network},


%0 Journal Article
%T A component-based video content representation for action recognition
%A Adeli Mosabbeb, Vida
%A Fazl-Ersi, Ehsan
%A Harati, Ahad
%J Image and Vision Computing
%@ 0262-8856
%D 2019