Frame rate and viseme analysis for multimedia applications

Jay J. Williams, Janet C. Rutledge, Dean C. Garsteckit, Aggelos K Katsaggelos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

In the future, multimedia technology will be able to provide video frame rates equal to or better than 30 frames-per-second (FPS). Until that time the hearing impaired community will be using band limited communication systems over un-shielded twisted pair copper wiring. As a result, multimedia communication systems will use a coder/decoder (CODEC) to compress the video and audio signals for transmission. For these systems to be usable by the hearing impaired community, the algorithms within the CODEC have to be designed to account for the perceptual boundaries of the hearing impaired. We investigate the perceptual boundaries of speech reading and multimedia technology, which are the constraints that effect speech reading performance. We analyze and draw conclusions on the relationship between viseme groupings, accuracy of viseme recognition, and presentation rate. These results are critical in the design of multimedia systems for the hearing impaired.

Original languageEnglish (US)
Title of host publication1997 IEEE 1st Workshop on Multimedia Signal Processing, MMSP 1997
EditorsYao Wang, Amy R. Reibman, B. H. Juang, Tsuhan Chen, Sun-Yuan Kung
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages13-18
Number of pages6
ISBN (Electronic)0780337808, 9780780337800
DOIs
StatePublished - Jan 1 1997
Event1st IEEE Workshop on Multimedia Signal Processing, MMSP 1997 - Princeton, United States
Duration: Jun 23 1997Jun 25 1997

Publication series

Name1997 IEEE 1st Workshop on Multimedia Signal Processing, MMSP 1997

Other

Other1st IEEE Workshop on Multimedia Signal Processing, MMSP 1997
Country/TerritoryUnited States
CityPrinceton
Period6/23/976/25/97

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology

Fingerprint

Dive into the research topics of 'Frame rate and viseme analysis for multimedia applications'. Together they form a unique fingerprint.

Cite this