Multimodal interfaces for inclusive learning

Marcelo Worsley*, David Barel, Lydia Davison, Thomas Large, Timothy Mwiti

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose that the artificial intelligence in education (AIED) community lead the charge in leveraging multimodal interfaces, in conjunction with artificial intelligence, to advance learning interfaces and experiences that are more inclusive. Recent years has seen the development of various multimodal technologies for capturing voice, gesture and gaze-based input modalities, as well as various forms of auditory and haptic feedback. These modalities could be powerful tools for developing inclusive learning interfaces. To ground this idea, we present a set of examples for how this work can be transformative in democratizing access to technology, while also democratizing designing and building technology. Additionally, our examples reinforce how designing for inclusive learning can result in improved learning interfaces for the general population.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings
EditorsRose Luckin, Kaska Porayska-Pomsta, Benedict du Boulay, Manolis Mavrikis, Carolyn Penstein Rosé, Bruce McLaren, Roberto Martinez-Maldonado, H. Ulrich Hoppe
PublisherSpringer Verlag
Pages389-393
Number of pages5
ISBN (Print)9783319938455
DOIs
StatePublished - Jan 1 2018
Event19th International Conference on Artificial Intelligence in Education, AIED 2018 - London, United Kingdom
Duration: Jun 27 2018Jun 30 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10948 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other19th International Conference on Artificial Intelligence in Education, AIED 2018
CountryUnited Kingdom
CityLondon
Period6/27/186/30/18

    Fingerprint

Keywords

  • Accessibility
  • Computer vision
  • Constructionism
  • Haptics
  • Speech
  • Tangibles

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Worsley, M., Barel, D., Davison, L., Large, T., & Mwiti, T. (2018). Multimodal interfaces for inclusive learning. In R. Luckin, K. Porayska-Pomsta, B. du Boulay, M. Mavrikis, C. Penstein Rosé, B. McLaren, R. Martinez-Maldonado, & H. U. Hoppe (Eds.), Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings (pp. 389-393). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10948 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-93846-2_73