Toward dynamic scene understanding by hierarchical motion pattern mining

Lei Song, Fan Jiang, Zhongke Shi, Rafael Molina, Aggelos K. Katsaggelos

Research output: Contribution to journalArticlepeer-review

13 Scopus citations


Our work addresses the problem of analyzing and understanding dynamic video scenes. A two-level motion pattern mining approach is proposed. At the first level, activities are modeled as distributions over patch-based features, including spatial location, moving direction, and speed. At the second level, traffic states are modeled as distributions over activities. Both patterns are shared among video clips. Compared to other works, one advantage of our method is that moving speed is considered to describe visual word. The other advantage is that traffic states are detected and assigned to every video frame. These enable finer semantic interpretation, more precise video segmentation, and anomaly detection. Specifically, every video frame is labeled by a certain traffic state, and the video is segmented frame by frame accordingly. Moving pixels in each frame, which do not belong to any activity or cannot exist in the corresponding traffic state, are detected as anomalies. We have successfully tested our approach on some challenging traffic surveillance sequences containing both pedestrian and vehicle motions.

Original languageEnglish (US)
Article number6746216
Pages (from-to)1273-1285
Number of pages13
JournalIEEE Transactions on Intelligent Transportation Systems
Issue number3
StatePublished - Jun 2014


  • Anomaly detection
  • Latent Dirichlet Allocation (LDA)
  • motion pattern analysis
  • video segmentation
  • visual surveillance

ASJC Scopus subject areas

  • Automotive Engineering
  • Mechanical Engineering
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Toward dynamic scene understanding by hierarchical motion pattern mining'. Together they form a unique fingerprint.

Cite this