Speeding up spatio-temporal sliding-window search for efficient event detection in crowded videos

Junsong Yuan*, Zicheng Liu, Ying Wu, Zhengyou Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

Despite previous successes of sliding window-based object detection in images, searching desired events in the volumetric video space is still a challenging problem, partially because the pattern search in spatio-temporal video space is much more complicated than that in spatial image space. Without knowing the location, temporal duration, and the spatial scale of the event, the search space for video events is prohibitively large for exhaustive search. To reduce the search complexity, we propose a heuristic branch-and-bound solution for event detection in videos. Unlike existing branch-and-bound method which searches for an optimal subvolume before comparing its detection score against the threshold, we aim at directly finding subvolumes whose scores are higher than the threshold. In doing so, many unnecessary branches are terminated much earlier, thus the search speed can be much faster. To validate this approach, we select three human action classes from the KTH dataset for training while testing with our own action dataset which has clutter and moving backgrounds as well as large variations in lighting, scale, and performing speed of actions. The experiment results show that our technique dramatically reduces computational cost without significantly degrading the quality of the detection results.

Original languageEnglish (US)
Title of host publication1st ACM International Workshop on Events in Multimedia - EiMM'09, Co-located with the 2009 ACM International Conference on Multimedia, MM'09
Pages3-8
Number of pages6
DOIs
StatePublished - Dec 21 2009
Event1st ACM International Workshop on Events in Multimedia - EiMM'09, Co-located with the 2009 ACM International Conference on Multimedia, MM'09 - Beijing, China
Duration: Oct 19 2009Oct 24 2009

Publication series

Name1st ACM International Workshop on Events in Multimedia - EiMM'09, Co-located with the 2009 ACM International Conference on Multimedia, MM'09

Other

Other1st ACM International Workshop on Events in Multimedia - EiMM'09, Co-located with the 2009 ACM International Conference on Multimedia, MM'09
CountryChina
CityBeijing
Period10/19/0910/24/09

Keywords

  • Event detection
  • Sliding window
  • Spatio-temporal pattern
  • Video pattern search

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint Dive into the research topics of 'Speeding up spatio-temporal sliding-window search for efficient event detection in crowded videos'. Together they form a unique fingerprint.

Cite this