Software architectures for incremental understanding of human speech

Gregory Aist*, James Allen, Ellen Campana, Lucian Galescu, Carlos A Gómez Gallo, Scott C. Stoness, Mary Swift, Michael Tanenhaus

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

The prevalent state of the art in spoken language understanding by spoken dialog systems is both modular and whole-utterance. It is modular in that incoming utterances are processed by independent components that handle different aspects, such as acoustics, syntax, semantics, and intention / goal recognition. It is whole-utterance in that each component completes its work for an entire utterance prior to handing off the utterance to the next component. However, a growing body of evidence suggests that humans do not process language that way. Rather, people process speech by rapidly integrating constraints from multiple sources of knowledge and multiple linguistic levels incrementally, as the utterance unfolds. In this paper we describe ongoing work aimed at developing an architecture that will allow machines to understand spoken language in a similar way. This revolutionary approach is promising for two reasons: 1) it more accurately reflects contemporary models of human language understanding, and 2) it results in empirical improvements including increased parsing performance.

Original languageEnglish (US)
Title of host publicationINTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP
PublisherInternational Speech Communication Association
Pages1922-1925
Number of pages4
ISBN (Print)9781604234497
StatePublished - 2006
EventINTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP - Pittsburgh, PA, United States
Duration: Sep 17 2006Sep 21 2006

Publication series

NameINTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP
Volume4

Other

OtherINTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP
Country/TerritoryUnited States
CityPittsburgh, PA
Period9/17/069/21/06

Keywords

  • Dialogue systems
  • Incremental understanding
  • Parsing
  • Psycholinguistics
  • Speech understanding

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Software architectures for incremental understanding of human speech'. Together they form a unique fingerprint.

Cite this