Spoken language acquisition via human-robot interaction

Qiong Liu; Thomas Huang; Ying Wu; Stephen Levinson

doi:10.1109/ICME.2001.1237871

Spoken language acquisition via human-robot interaction

Qiong Liu^*, Thomas Huang, Ying Wu, Stephen Levinson

^*Corresponding author for this work

Electrical and Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a subproject of a challenging project that explores teaching a computer human-intelligence. In the subproject, a multisensory mobile robot is used as the interface for human-computer interaction, and spoken language is taught to the computer through natural human-robot interaction. Different from state-of-The-art speech recognizers, our approach associates speech patterns directly with sensory inputs of the robot. This approach allows our system to learn multilingual speech patterns online. Further investigation of this project will include human-computer interaction that involves more modalities, and applications that use the proposed idea to train home appliances.

Original language	English (US)
Title of host publication	Proceedings - IEEE International Conference on Multimedia and Expo
Publisher	IEEE Computer Society
Pages	913-916
Number of pages	4
ISBN (Electronic)	0769511988
DOIs	https://doi.org/10.1109/ICME.2001.1237871
State	Published - 2001
Event	2001 IEEE International Conference on Multimedia and Expo, ICME 2001 - Tokyo, Japan Duration: Aug 22 2001 → Aug 25 2001

Publication series

Name	Proceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)	1945-7871
ISSN (Electronic)	1945-788X

Other

Other	2001 IEEE International Conference on Multimedia and Expo, ICME 2001
Country/Territory	Japan
City	Tokyo
Period	8/22/01 → 8/25/01

ASJC Scopus subject areas

Computer Networks and Communications
Computer Science Applications

Access to Document

10.1109/ICME.2001.1237871

Cite this

@inproceedings{e2b7f8602c1b4a059a8c09434c144d90,

title = "Spoken language acquisition via human-robot interaction",

abstract = "This paper presents a subproject of a challenging project that explores teaching a computer human-intelligence. In the subproject, a multisensory mobile robot is used as the interface for human-computer interaction, and spoken language is taught to the computer through natural human-robot interaction. Different from state-of-The-art speech recognizers, our approach associates speech patterns directly with sensory inputs of the robot. This approach allows our system to learn multilingual speech patterns online. Further investigation of this project will include human-computer interaction that involves more modalities, and applications that use the proposed idea to train home appliances.",

author = "Qiong Liu and Thomas Huang and Ying Wu and Stephen Levinson",

year = "2001",

doi = "10.1109/ICME.2001.1237871",

language = "English (US)",

series = "Proceedings - IEEE International Conference on Multimedia and Expo",

publisher = "IEEE Computer Society",

pages = "913--916",

booktitle = "Proceedings - IEEE International Conference on Multimedia and Expo",

address = "United States",

}

Liu, Q, Huang, T, Wu, Y & Levinson, S 2001, Spoken language acquisition via human-robot interaction. in Proceedings - IEEE International Conference on Multimedia and Expo., 1237871, Proceedings - IEEE International Conference on Multimedia and Expo, IEEE Computer Society, pp. 913-916, 2001 IEEE International Conference on Multimedia and Expo, ICME 2001, Tokyo, Japan, 8/22/01. https://doi.org/10.1109/ICME.2001.1237871

Spoken language acquisition via human-robot interaction. / Liu, Qiong; Huang, Thomas; Wu, Ying et al.

Proceedings - IEEE International Conference on Multimedia and Expo. IEEE Computer Society, 2001. p. 913-916 1237871 (Proceedings - IEEE International Conference on Multimedia and Expo).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Spoken language acquisition via human-robot interaction

AU - Liu, Qiong

AU - Huang, Thomas

AU - Wu, Ying

AU - Levinson, Stephen

PY - 2001

Y1 - 2001

N2 - This paper presents a subproject of a challenging project that explores teaching a computer human-intelligence. In the subproject, a multisensory mobile robot is used as the interface for human-computer interaction, and spoken language is taught to the computer through natural human-robot interaction. Different from state-of-The-art speech recognizers, our approach associates speech patterns directly with sensory inputs of the robot. This approach allows our system to learn multilingual speech patterns online. Further investigation of this project will include human-computer interaction that involves more modalities, and applications that use the proposed idea to train home appliances.

AB - This paper presents a subproject of a challenging project that explores teaching a computer human-intelligence. In the subproject, a multisensory mobile robot is used as the interface for human-computer interaction, and spoken language is taught to the computer through natural human-robot interaction. Different from state-of-The-art speech recognizers, our approach associates speech patterns directly with sensory inputs of the robot. This approach allows our system to learn multilingual speech patterns online. Further investigation of this project will include human-computer interaction that involves more modalities, and applications that use the proposed idea to train home appliances.

UR - http://www.scopus.com/inward/record.url?scp=84908283529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908283529&partnerID=8YFLogxK

U2 - 10.1109/ICME.2001.1237871

DO - 10.1109/ICME.2001.1237871

M3 - Conference contribution

AN - SCOPUS:84908283529

T3 - Proceedings - IEEE International Conference on Multimedia and Expo

SP - 913

EP - 916

BT - Proceedings - IEEE International Conference on Multimedia and Expo

PB - IEEE Computer Society

T2 - 2001 IEEE International Conference on Multimedia and Expo, ICME 2001

Y2 - 22 August 2001 through 25 August 2001

ER -

Spoken language acquisition via human-robot interaction

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this