Modeling the impact of shared visual information on collaborative reference

Darren Gergle*, Carolyn P. Rose, Robert E. Kraut

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Scopus citations

Abstract

A number of recent studies have demonstrated that groups benefit considerably from access to shared visual information. This is due, in part, to the communicative efficiencies provided by the shared visual context. However, a large gap exists between our current theoretical understanding and our existing models. We address this gap by developing a computational model that integrates linguistic cues with visual cues in a way that effectively models reference during tightly-coupled, task-oriented interactions. The results demonstrate that an integrated model significantly outperforms existing language-only and visual-only models. The findings can be used to inform and augment the development of conversational agents, applications that dynamically track discourse and collaborative interactions, and dialogue managers for natural language interfaces.

Original languageEnglish (US)
Title of host publicationProceedings of the SIGCHI Conference on Human Factors in Computing Systems 2007, CHI 2007
PublisherAssociation for Computing Machinery
Pages1543-1552
Number of pages10
ISBN (Print)1595935932, 9781595935939
DOIs
StatePublished - Jan 1 2007
Event25th SIGCHI Conference on Human Factors in Computing Systems 2007, CHI 2007 - San Jose, CA, United States
Duration: Apr 28 2007May 3 2007

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Other

Other25th SIGCHI Conference on Human Factors in Computing Systems 2007, CHI 2007
CountryUnited States
CitySan Jose, CA
Period4/28/075/3/07

Keywords

  • Communication
  • Discourse
  • Language use
  • Modeling
  • Multimodal interaction
  • Shared visual information

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Modeling the impact of shared visual information on collaborative reference'. Together they form a unique fingerprint.

  • Cite this

    Gergle, D., Rose, C. P., & Kraut, R. E. (2007). Modeling the impact of shared visual information on collaborative reference. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2007, CHI 2007 (pp. 1543-1552). (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/1240624.1240858