Activity detection using sequential statistical boundary detection (SSBD)

Konstantinos Avgerinakis*, Alexia Briassouli, Ioannis Kompatsiaris

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

The spiralling increase of video data has rendered the automated localization and recognition of activities an essential step for video content understanding. In this work, we introduce novel algorithms for detecting human activities in the spatial domain via a binary activity detection mask, the Motion Boundary Activity Area (MBAA), and in the time domain by a new approach, Statistical Sequential Boundary Detection (SSBD). MBAAs are estimated by analyzing the motion vectors using the Kurtosis metric, while dense trajectories are extracted and described using a low level HOGHOF descriptor and high level Fisher representation scheme, modeling a Support Vector Data Description (SVDD) hypersphere. SSBD is then realized by applying Sequential Change Detection with the Cumulative Sum (CUSUM) algorithm on the distances between Fisher data descriptors and the corresponding reference SVDD hyperspheres for rapid detection of changes in the activity pattern. Activities in the resulting video subsequences are then classified using an multi-class SVM model, leading to state of the art results. Our experiments with benchmark and real world data demonstrate that our technique is successful in reducing the computational cost and also in improving activity detection rates. (C) 2015 Elsevier Inc. All rights reserved.

Original languageEnglish
Pages (from-to)46-61
Number of pages16
JournalComputer Vision and Image Understanding
Volume144
DOIs
Publication statusPublished - Mar 2016
Externally publishedYes

Keywords

  • Activity detection
  • Activity localization
  • Activity recognition
  • LOCALIZATION
  • Motion segmentation

Cite this