Abstract
Current video conference and phone systems do not provide the necessary temporal resolution and motion for speechreading. In this paper the perceptual boundaries which effect speechreading performance are investigated. Analysis of the relationships between viseme groupings, accuracy of viseme recognition and presentation frame rate is presented based on the results of subject testing. Results reveal a minimum frame rate of 10 frames per second (fps) for distinguishing viseme groupings. Confusion analysis results demonstrate the importance of the tongue and teeth oral features for speechreading. These results are critical to the design of speech-assisted video systems to enhance speechreading for individuals with impaired hearing.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 7-23 |
| Number of pages | 17 |
| Journal | Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology |
| Volume | 20 |
| Issue number | 1-2 |
| State | Published - Dec 1 1998 |
ASJC Scopus subject areas
- Signal Processing
- Information Systems
- Electrical and Electronic Engineering