Rate-distortion optimized video summary generation and transmission over packet lossy networks

Peshala V. Pahalawatta*, Zhu Li, Fan Zhai, Aggelos K. Katsaggelos

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

9 Scopus citations


The goal of video summarization is to select key frames from a video sequence in order to generate an optimal summary that can accommodate constraints on viewing time, storage, or bandwidth. While video summary generation without transmission considerations has been studied extensively, the problem of rate-distortion optimized summary generation and transmission in a packet-lossy network has gained little attention. We consider the transmission of summarized video over a packet-lossy network such as the Internet. We depart from traditional rate control methods by not sacrificing the image quality of each transmitted frame but instead focusing on the frames that can be dropped without seriously affecting the quality of the video sequence. We take into account the packet loss probability, and use the end-to-end distortion to optimize the video quality given constraints on the temporal rate of the summary. Different network scenarios such as when a feedback channel is not available, and when a feedback channel is available with the possibility of retransmission, are considered. In each case, we assume a strict end-to-end delay constraint such that the summarized video can be viewed in real-time. We show simulation results for each case, and also discuss the case when the feedback delay may not be constant.

Original languageEnglish (US)
Article number91
Pages (from-to)801-809
Number of pages9
JournalProceedings of SPIE - The International Society for Optical Engineering
Issue numberPART 2
StatePublished - 2005
EventProceedings of SPIE-IS and T Electronic Imaging - Image and Video Communications and Processing 2005 - San Jose, CA, United States
Duration: Jan 18 2005Jan 20 2005


  • Internet
  • Video streaming
  • Video summarization

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Rate-distortion optimized video summary generation and transmission over packet lossy networks'. Together they form a unique fingerprint.

Cite this