Non-sequential video content representation using temporal variation of feature vectors

In this paper, an efficient and low complexity algorithm for non-sequential video content representation is proposed. Our method is based on extractin g a set of limited but meaningful frames (key-frames), able to represent th e video content, The temporal variation of feature vectors for all frames w ithin a shot, which form a trajectory in a high dimensional space, is used for key-frame selection, In particular, key-frames are extracted by estimat ing appropriate curve points, able to characterize the feature trajectory. The magnitude of the second derivative of the frame feature vectors with re spect to time is used as a curvature measure in our approach. Due to low co mplexity of the algorithm, the proposed method can be easily implemented in hardware devices of even low processing capabilities thus can be embedded in many consumer electronics systems. For feature vector formulation, the v ideo is first analyzed and several descriptors are extracted using a multis cale implementation of the Recursive Shortest Spanning Tree (RSST) algorith m, which significantly reduces the segmentation complexity. In addition, th e whole procedure exploits information that exists in MPEG video databases so as to achieve a faster implementation. Finally, the extracted descriptor s are classified using a fuzzy formulation scheme. Experimental results to real-life video sequences are presented to indicate the good performance of the proposed algorithm.