Joint block-based video source/channel coding for packet-switched networks

Block-based video coders rely on motion compensated block prediction for more data compression. With the introduction of video coding over packet-switched networks such as the Internet and the resulting packet loss that occurs on congested networks, coding mode selection for each macro-block is significant in determining the overall distortion on the decoded video sequence. In this work, we examine the problem of mode selection for macro-blocks in the presence of loss and a channel rate constraint. We present and evaluate several methods for mode selection that attempt to minimize perceptual distortion from packet loss. We formulate a simplified problem which is useful for gaining some insight, and present an efficient algorithm to finding an optimal solution.