Modeling culturally authentic style shifting with virtual peers

Justine Cassell*, Kathleen Geraghty, Berto Gonzalez, John Borland

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of "code-switching" between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.

Original languageEnglish (US)
Title of host publicationICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces
Pages135-142
Number of pages8
DOIs
StatePublished - Dec 1 2009
EventInternational Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09 - Cambridge, MA, United States
Duration: Nov 2 2009Nov 6 2009

Publication series

NameICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Other

OtherInternational Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09
CountryUnited States
CityCambridge, MA
Period11/2/0911/6/09

Keywords

  • Analysis and modeling of verbal and nonverbal interaction
  • Culture
  • Embodied conversational agents

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Cite this

Cassell, J., Geraghty, K., Gonzalez, B., & Borland, J. (2009). Modeling culturally authentic style shifting with virtual peers. In ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces (pp. 135-142). (ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces). https://doi.org/10.1145/1647314.1647338