Mining compositional features from gps and visual cues for event recognition in photo collections

Junsong Yuan*, Jiebo Luo, Ying Wu

*Corresponding author for this work

Research output: Contribution to journalArticle

28 Scopus citations

Abstract

As digital cameras with Global Positioning System (GPS) capability become available and people geotag their photos using other means, it is of great interest to annotate semantic events (e.g., hiking, skiing, party) characterized by a collection of geotagged photos with timestamps and GPS information at the capture. We address this emerging event classification problem by mining informative features derived from image contents and spatio-temporal traces of GPS coordinates that characterize the underlying movement patterns of various event types, both based on the entire collection as opposed to individual photos. Considering that events are better described by the co-occurrence of objects and scenes, we bundle primitive features such as color and texture histograms or GPS features to form the discriminative compositional feature. A data mining method is proposed to efficiently discover discriminative compositional features of small classification errors. A theoretical analysis is also presented to guide the selection of the data mining parameters. Upon compositional feature mining, we perform the multiclass AdaBoost to further integrate the mined compositional features. Finally, the GPS and visual modalities are united through a confidence-based fusion. Based on a dataset of more than 3000 geotagged images, experimental results have shown the synergy of all of the components in our proposed approach to event classification.

Original languageEnglish (US)
Article number5475268
Pages (from-to)705-716
Number of pages12
JournalIEEE Transactions on Multimedia
Volume12
Issue number7
DOIs
StatePublished - Nov 1 2010

Keywords

  • Compositional feature mining
  • event recognition
  • geo-tagged images
  • image data mining

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Mining compositional features from gps and visual cues for event recognition in photo collections'. Together they form a unique fingerprint.

  • Cite this