See what i'm saying?: Using Dyadic Mobile Eye tracking to study collaborative reference

Darren Gergle; Alan T. Clark

doi:10.1145/1958824.1958892

See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference

Darren Gergle^*, Alan T. Clark

^*Corresponding author for this work

Communication Studies

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

35 Scopus citations

Abstract

To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

Original language	English (US)
Title of host publication	Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011
Pages	435-444
Number of pages	10
DOIs	https://doi.org/10.1145/1958824.1958892
State	Published - Apr 29 2011
Event	ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011 - Hangzhou, China Duration: Mar 19 2011 → Mar 23 2011

Publication series

Name	Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Other

Other	ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011
Country	China
City	Hangzhou
Period	3/19/11 → 3/23/11

Keywords

Dual eye tracking
Dyadic interaction
Gaze
Language
Reference
Shared visual space

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Networks and Communications

Access to Document

10.1145/1958824.1958892

Fingerprint Dive into the research topics of 'See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference'. Together they form a unique fingerprint.

Cite this

Gergle, D., & Clark, A. T. (2011). See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011 (pp. 435-444). (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). https://doi.org/10.1145/1958824.1958892

@inproceedings{85861c6798a14d0490b142961088b323,

title = "See what i'm saying?: Using Dyadic Mobile Eye tracking to study collaborative reference",

abstract = "To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.",

keywords = "Dual eye tracking, Dyadic interaction, Gaze, Language, Reference, Shared visual space",

author = "Darren Gergle and Clark, {Alan T.}",

year = "2011",

month = apr,

day = "29",

doi = "10.1145/1958824.1958892",

language = "English (US)",

isbn = "9781450305563",

series = "Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW",

pages = "435--444",

booktitle = "Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011",

note = "ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011 ; Conference date: 19-03-2011 Through 23-03-2011",

}

Gergle, D & Clark, AT 2011, See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. in Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, pp. 435-444, ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011, Hangzhou, China, 3/19/11. https://doi.org/10.1145/1958824.1958892

See what i'm saying? Using Dyadic Mobile Eye tracking to study collaborative reference. / Gergle, Darren; Clark, Alan T.

Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011. 2011. p. 435-444 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - See what i'm saying?

T2 - ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011

AU - Gergle, Darren

AU - Clark, Alan T.

PY - 2011/4/29

Y1 - 2011/4/29

N2 - To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

AB - To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.

KW - Dual eye tracking

KW - Dyadic interaction

KW - Gaze

KW - Language

KW - Reference

KW - Shared visual space

UR - http://www.scopus.com/inward/record.url?scp=79955158932&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79955158932&partnerID=8YFLogxK

U2 - 10.1145/1958824.1958892

DO - 10.1145/1958824.1958892

M3 - Conference contribution

AN - SCOPUS:79955158932

SN - 9781450305563

T3 - Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

SP - 435

EP - 444

BT - Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW 2011

Y2 - 19 March 2011 through 23 March 2011

ER -