Modeling culturally authentic style shifting with virtual peers

Justine Cassell; Kathleen Geraghty; Berto Gonzalez; John Borland

doi:10.1145/1647314.1647338

Modeling culturally authentic style shifting with virtual peers

Justine Cassell^*, Kathleen Geraghty, Berto Gonzalez, John Borland

^*Corresponding author for this work

Linguistics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

13 Scopus citations

Abstract

We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of "code-switching" between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.

Original language	English (US)
Title of host publication	ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces
Pages	135-142
Number of pages	8
DOIs	https://doi.org/10.1145/1647314.1647338
State	Published - 2009
Event	International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09 - Cambridge, MA, United States Duration: Nov 2 2009 → Nov 6 2009

Publication series

Name	ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Other

Other	International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09
Country/Territory	United States
City	Cambridge, MA
Period	11/2/09 → 11/6/09

Keywords

Analysis and modeling of verbal and nonverbal interaction
Culture
Embodied conversational agents

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Human-Computer Interaction

Access to Document

10.1145/1647314.1647338

Cite this

Cassell, J., Geraghty, K., Gonzalez, B., & Borland, J. (2009). Modeling culturally authentic style shifting with virtual peers. In ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces (pp. 135-142). (ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces). https://doi.org/10.1145/1647314.1647338

Cassell, Justine ; Geraghty, Kathleen ; Gonzalez, Berto et al. / Modeling culturally authentic style shifting with virtual peers. ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces. 2009. pp. 135-142 (ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces).

@inproceedings{fc595b902420476ab41e1555d8ea4981,

title = "Modeling culturally authentic style shifting with virtual peers",

abstract = "We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of {"}code-switching{"} between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.",

keywords = "Analysis and modeling of verbal and nonverbal interaction, Culture, Embodied conversational agents",

author = "Justine Cassell and Kathleen Geraghty and Berto Gonzalez and John Borland",

year = "2009",

doi = "10.1145/1647314.1647338",

language = "English (US)",

isbn = "9781605587721",

series = "ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces",

pages = "135--142",

booktitle = "ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces",

note = "International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09 ; Conference date: 02-11-2009 Through 06-11-2009",

}

Cassell, J, Geraghty, K, Gonzalez, B & Borland, J 2009, Modeling culturally authentic style shifting with virtual peers. in ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces. ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, pp. 135-142, International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09, Cambridge, MA, United States, 11/2/09. https://doi.org/10.1145/1647314.1647338

Modeling culturally authentic style shifting with virtual peers. / Cassell, Justine; Geraghty, Kathleen; Gonzalez, Berto et al.
ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces. 2009. p. 135-142 (ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Modeling culturally authentic style shifting with virtual peers

AU - Cassell, Justine

AU - Geraghty, Kathleen

AU - Gonzalez, Berto

AU - Borland, John

PY - 2009

Y1 - 2009

N2 - We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of "code-switching" between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.

AB - We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of "code-switching" between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.

KW - Analysis and modeling of verbal and nonverbal interaction

KW - Culture

KW - Embodied conversational agents

UR - http://www.scopus.com/inward/record.url?scp=74049159408&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=74049159408&partnerID=8YFLogxK

U2 - 10.1145/1647314.1647338

DO - 10.1145/1647314.1647338

M3 - Conference contribution

AN - SCOPUS:74049159408

SN - 9781605587721

T3 - ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

SP - 135

EP - 142

BT - ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

T2 - International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces, ICMI-MLMI'09

Y2 - 2 November 2009 through 6 November 2009

ER -

Cassell J, Geraghty K, Gonzalez B, Borland J. Modeling culturally authentic style shifting with virtual peers. In ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces. 2009. p. 135-142. (ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces). doi: 10.1145/1647314.1647338

Modeling culturally authentic style shifting with virtual peers

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this