(Dis)Engagement matters

Identifying efficacious learning practices with multimodal learning analytics

Marcelo Aaron Bonilla Worsley*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Video analysis is a staple of the education research community. For many contemporary education researchers, participation in the video coding process serves as a rite of passage. However, recent developments in multimodal learning analytics May help to accelerate and enhance this process by providing researchers with a more nuanced glimpse into a set of learning experiences. As an example of how to use multimodal learning analytics towards these ends, this paper includes a preliminary analysis from 54 college students, who completed two engineering design tasks in pairs. Gesture, speech and electro-dermal activation data were collected as students completed these tasks. The gesture data was used to learn a set of canonical clusters (N=4). A decision tree was trained based on individual students’ cluster frequencies, and pre-post learning gains. The nodes in the decision tree were then used to identify a subset of video segments that were human coded based on prior work in learning analytics and engineering design. The combination of machine learning and human inference helps elucidate the practices that seem to correlate with student learning. In particular, both engagement and disengagement seem to correlate with student learning, albeit in a somewhat nuanced fashion.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th International Conference on Learning Analytics and Knowledge
Subtitle of host publicationTowards User-Centred Learning Analytics, LAK 2018
PublisherAssociation for Computing Machinery
Pages365-369
Number of pages5
ISBN (Electronic)9781450364003
DOIs
StatePublished - Mar 7 2018
Event8th International Conference on Learning Analytics and Knowledge, LAK 2018 - Sydney, Australia
Duration: Mar 5 2018Mar 9 2018

Publication series

NameACM International Conference Proceeding Series

Other

Other8th International Conference on Learning Analytics and Knowledge, LAK 2018
CountryAustralia
CitySydney
Period3/5/183/9/18

Fingerprint

Students
Decision trees
Education
Image coding
Learning systems
Chemical activation

Keywords

  • Collaboration
  • Engineering design
  • Gesture
  • Qualitative analysis

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Worsley, M. A. B. (2018). (Dis)Engagement matters: Identifying efficacious learning practices with multimodal learning analytics. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018 (pp. 365-369). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3170358.3170420
Worsley, Marcelo Aaron Bonilla. / (Dis)Engagement matters : Identifying efficacious learning practices with multimodal learning analytics. Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. pp. 365-369 (ACM International Conference Proceeding Series).
@inproceedings{0eb5b46849c142e2847aac4dba1d99f3,
title = "(Dis)Engagement matters: Identifying efficacious learning practices with multimodal learning analytics",
abstract = "Video analysis is a staple of the education research community. For many contemporary education researchers, participation in the video coding process serves as a rite of passage. However, recent developments in multimodal learning analytics May help to accelerate and enhance this process by providing researchers with a more nuanced glimpse into a set of learning experiences. As an example of how to use multimodal learning analytics towards these ends, this paper includes a preliminary analysis from 54 college students, who completed two engineering design tasks in pairs. Gesture, speech and electro-dermal activation data were collected as students completed these tasks. The gesture data was used to learn a set of canonical clusters (N=4). A decision tree was trained based on individual students’ cluster frequencies, and pre-post learning gains. The nodes in the decision tree were then used to identify a subset of video segments that were human coded based on prior work in learning analytics and engineering design. The combination of machine learning and human inference helps elucidate the practices that seem to correlate with student learning. In particular, both engagement and disengagement seem to correlate with student learning, albeit in a somewhat nuanced fashion.",
keywords = "Collaboration, Engineering design, Gesture, Qualitative analysis",
author = "Worsley, {Marcelo Aaron Bonilla}",
year = "2018",
month = "3",
day = "7",
doi = "10.1145/3170358.3170420",
language = "English (US)",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
pages = "365--369",
booktitle = "Proceedings of the 8th International Conference on Learning Analytics and Knowledge",

}

Worsley, MAB 2018, (Dis)Engagement matters: Identifying efficacious learning practices with multimodal learning analytics. in Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. ACM International Conference Proceeding Series, Association for Computing Machinery, pp. 365-369, 8th International Conference on Learning Analytics and Knowledge, LAK 2018, Sydney, Australia, 3/5/18. https://doi.org/10.1145/3170358.3170420

(Dis)Engagement matters : Identifying efficacious learning practices with multimodal learning analytics. / Worsley, Marcelo Aaron Bonilla.

Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. p. 365-369 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - (Dis)Engagement matters

T2 - Identifying efficacious learning practices with multimodal learning analytics

AU - Worsley, Marcelo Aaron Bonilla

PY - 2018/3/7

Y1 - 2018/3/7

N2 - Video analysis is a staple of the education research community. For many contemporary education researchers, participation in the video coding process serves as a rite of passage. However, recent developments in multimodal learning analytics May help to accelerate and enhance this process by providing researchers with a more nuanced glimpse into a set of learning experiences. As an example of how to use multimodal learning analytics towards these ends, this paper includes a preliminary analysis from 54 college students, who completed two engineering design tasks in pairs. Gesture, speech and electro-dermal activation data were collected as students completed these tasks. The gesture data was used to learn a set of canonical clusters (N=4). A decision tree was trained based on individual students’ cluster frequencies, and pre-post learning gains. The nodes in the decision tree were then used to identify a subset of video segments that were human coded based on prior work in learning analytics and engineering design. The combination of machine learning and human inference helps elucidate the practices that seem to correlate with student learning. In particular, both engagement and disengagement seem to correlate with student learning, albeit in a somewhat nuanced fashion.

AB - Video analysis is a staple of the education research community. For many contemporary education researchers, participation in the video coding process serves as a rite of passage. However, recent developments in multimodal learning analytics May help to accelerate and enhance this process by providing researchers with a more nuanced glimpse into a set of learning experiences. As an example of how to use multimodal learning analytics towards these ends, this paper includes a preliminary analysis from 54 college students, who completed two engineering design tasks in pairs. Gesture, speech and electro-dermal activation data were collected as students completed these tasks. The gesture data was used to learn a set of canonical clusters (N=4). A decision tree was trained based on individual students’ cluster frequencies, and pre-post learning gains. The nodes in the decision tree were then used to identify a subset of video segments that were human coded based on prior work in learning analytics and engineering design. The combination of machine learning and human inference helps elucidate the practices that seem to correlate with student learning. In particular, both engagement and disengagement seem to correlate with student learning, albeit in a somewhat nuanced fashion.

KW - Collaboration

KW - Engineering design

KW - Gesture

KW - Qualitative analysis

UR - http://www.scopus.com/inward/record.url?scp=85045901435&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045901435&partnerID=8YFLogxK

U2 - 10.1145/3170358.3170420

DO - 10.1145/3170358.3170420

M3 - Conference contribution

T3 - ACM International Conference Proceeding Series

SP - 365

EP - 369

BT - Proceedings of the 8th International Conference on Learning Analytics and Knowledge

PB - Association for Computing Machinery

ER -

Worsley MAB. (Dis)Engagement matters: Identifying efficacious learning practices with multimodal learning analytics. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery. 2018. p. 365-369. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3170358.3170420