Scribble tracker: A matting-based approach for robust tracking

Jialue Fan*, Xiaohui Shen, Ying Wu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

83 Scopus citations


Model updating is a critical problem in tracking. Inaccurate extraction of the foreground and background information in model adaptation would cause the model to drift and degrade the tracking performance. The most direct yet difficult solution to the drift problem is to obtain accurate boundaries of the target. We approach such a solution by proposing a novel model adaptation framework based on the combination of matting and tracking. In our framework, coarse tracking results automatically provide sufficient and accurate scribbles for matting, which makes matting applicable in a tracking system. Meanwhile, accurate boundaries of the target can be obtained from matting results even when the target has large deformation. An effective model combining short-term features and long-term appearances is further constructed and successfully updated based on such accurate boundaries. The model can successfully handle occlusion by explicit inference. Extensive experiments show that our adaptation scheme largely avoids model drift and significantly outperforms other discriminative tracking models.

Original languageEnglish (US)
Article number6109277
Pages (from-to)1633-1644
Number of pages12
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Issue number8
StatePublished - 2012


  • Visual tracking
  • matting
  • model updating
  • video analysis

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Scribble tracker: A matting-based approach for robust tracking'. Together they form a unique fingerprint.

Cite this