Sub-component modeling for face image reconstruction in video communications

Derek J. Shiell, Jing Xiao, Aggelos K. Katsaggelos

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Emerging communications trends point to streaming video as a new form of content delivery. These systems are implemented over wired systems, such as cable or ethernet, and wireless networks, cell phones, and portable game systems. These communications systems require sophisticated methods of compression and error-resilience encoding to enable communications across band-limited and noisy delivery channels. Additionally, the transmitted video data must be of high enough quality to ensure a satisfactory end-user experience. Traditionally, video compression makes use of temporal and spatial coherence to reduce the information required to represent an image. In many communications systems, the communications channel is characterized by a probabilistic model which describes the capacity or fidelity of the channel. The implication is that information is lost or distorted in the channel, and requires concealment on the receiving end. We demonstrate a generative model based transmission scheme to compress human face images in video, which has the advantages of a potentially higher compression ratio, while maintaining robustness to errors and data corruption. This is accomplished by training an offline face model and using the model to reconstruct face images on the receiving end. We propose a sub-component AAM modeling the appearance of sub-facial components individually, and show face reconstruction results under different types of video degradation using a weighted and non-weighted version of the sub-component AAM.

Original languageEnglish (US)
Title of host publicationApplications of Digital Image Processing XXXI
StatePublished - 2008
EventApplications of Digital Image Processing XXXI - San Diego, CA, United States
Duration: Aug 11 2008Aug 14 2008

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


OtherApplications of Digital Image Processing XXXI
Country/TerritoryUnited States
CitySan Diego, CA


  • Active appearance models
  • Face modeling
  • Face reconstruction
  • Model-based reconstruction
  • Sub-component AAM
  • Weighted AAM

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Sub-component modeling for face image reconstruction in video communications'. Together they form a unique fingerprint.

Cite this