See what i'm saying?: Using Dyadic Mobile Eye tracking to study collaborative reference

Darren Gergle; Alan T. Clark

doi:10.1145/1958824.1958892

See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference

Darren Gergle^*, Alan T. Clark

^*Corresponding author for this work

Communication Studies

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

42 Scopus citations

Abstract

To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

Original language	English (US)
Title of host publication	Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011
Publisher	Association for Computing Machinery
Pages	435-444
Number of pages	10
ISBN (Print)	9781450305563
DOIs	https://doi.org/10.1145/1958824.1958892
State	Published - 2011
Event	ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011 - Hangzhou, China Duration: Mar 19 2011 → Mar 23 2011

Publication series

Name	Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Other

Other	ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011
Country/Territory	China
City	Hangzhou
Period	3/19/11 → 3/23/11

Keywords

Dual eye tracking
Dyadic interaction
Gaze
Language
Reference
Shared visual space

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Networks and Communications

Access to Document

10.1145/1958824.1958892

Cite this

Gergle, D., & Clark, A. T. (2011). See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011 (pp. 435-444). (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). Association for Computing Machinery. https://doi.org/10.1145/1958824.1958892

@inproceedings{85861c6798a14d0490b142961088b323,

title = "See what i'm saying?: Using Dyadic Mobile Eye tracking to study collaborative reference",

abstract = "To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.",

keywords = "Dual eye tracking, Dyadic interaction, Gaze, Language, Reference, Shared visual space",

author = "Darren Gergle and Clark, {Alan T.}",

year = "2011",

doi = "10.1145/1958824.1958892",

language = "English (US)",

isbn = "9781450305563",

series = "Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW",

publisher = "Association for Computing Machinery",

pages = "435--444",

booktitle = "Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011",

}

Gergle, D & Clark, AT 2011, See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. in Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, Association for Computing Machinery, pp. 435-444, ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011, Hangzhou, China, 3/19/11. https://doi.org/10.1145/1958824.1958892

See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. / Gergle, Darren; Clark, Alan T.

Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011. Association for Computing Machinery, 2011. p. 435-444 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - See what i'm saying?

T2 - ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011

AU - Gergle, Darren

AU - Clark, Alan T.

PY - 2011

Y1 - 2011

N2 - To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

AB - To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

KW - Dual eye tracking

KW - Dyadic interaction

KW - Gaze

KW - Language

KW - Reference

KW - Shared visual space

UR - http://www.scopus.com/inward/record.url?scp=79955158932&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79955158932&partnerID=8YFLogxK

U2 - 10.1145/1958824.1958892

DO - 10.1145/1958824.1958892

M3 - Conference contribution

AN - SCOPUS:79955158932

SN - 9781450305563

T3 - Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

SP - 435

EP - 444

BT - Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011

PB - Association for Computing Machinery

Y2 - 19 March 2011 through 23 March 2011

ER -

Gergle D, Clark AT. See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011. Association for Computing Machinery. 2011. p. 435-444. (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). https://doi.org/10.1145/1958824.1958892