Visual augmentation of deictic gestures in MOOC videos

Kshitij Sharma, Sarah D'Angelo, Darren Gergle, Pierre Dillenbourg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Scopus citations

Abstract

We present an eye-tracking study to compare different modalities for visual augmentations of the teacher's explicit deictic gestures on a video lecture. We compared three visualizations: 1) hand gestures with a pointer, 2) gaze overlay, and 3) no-augmentation baseline. We investigate the teacher-student pair in a video-based learning context as an abstraction of an expert-novice pair where the goal is to attain a high level of shared understanding. The key phase of having a shared understanding is to have a common ground between the pair. Previous studies showed that explicit deixis plays a major role in initiating and maintaining common ground. This led us to hypothesize that augmenting videos with teacher's deictic gestures might help students perform better. We found that augmenting the video with teacher's gaze results in higher learning gain than no visualization. Moreover, gaze visualization also helped students in maintaining longer attention spans than hand gestures.

Original languageEnglish (US)
Title of host publication12th International Conference of the Learning Sciences, ICLS 2016
Subtitle of host publicationTransforming Learning, Empowering Learners, Proceedings
PublisherInternational Society of the Learning Sciences (ISLS)
Pages202-209
Number of pages8
Volume1
ISBN (Electronic)9780990355090
StatePublished - Jan 1 2016
Event12th International Conference of the Learning Sciences: Transforming Learning, Empowering Learners, ICLS 2016 - Singapore, Singapore
Duration: Jun 20 2016Jun 24 2016

Other

Other12th International Conference of the Learning Sciences: Transforming Learning, Empowering Learners, ICLS 2016
Country/TerritorySingapore
CitySingapore
Period6/20/166/24/16

Keywords

  • Eye-tracking
  • Learning analytics
  • MOOCs
  • Online deixis

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Education

Fingerprint

Dive into the research topics of 'Visual augmentation of deictic gestures in MOOC videos'. Together they form a unique fingerprint.

Cite this