Project Details
Description
This proposal combines the excitement presented by Making, as instantiated through Minecraft, with the affordances and opportunities that can be realized through artificial intelligence and multimodal interfaces. Specifically, the last several years has seen advances in the adoption and utilization of Minecraft as a novel, collaborative, learning platform, as well as the popularization of speech- (e.g., Google Home, Siri, and Amazon’s Alexa) and gesture-enabled interfaces (e.g., Xbox Kinect, Nintendo Wii, Leap Motion). This proposal builds on those capabilities to consider ways that intelligent, multimodal, naturalistic interfaces can support a novel and effective paradigm for learning and working. In this way, this work is positioned as exploring the genre of multimodal interfaces for supporting collaborative creation of digital artifacts and learning.
Recent developments in multimodal sensor technologies are creating novel opportunities for naturalistic multimodal interfaces. These interfaces include speech-, gesture-, touch-, video- and gaze-based input and feedback. We will leverage these technologies to develop a multimodal interface for creating, mining and exploring in Minecraft. Furthermore, the design of the platform will include important features, such as: ability to use natural language and gaze for mining, exploring and building, naming custom-designed objects to simplify their reuse, interpretation of simple mathematical operations and shapes, and the ability to quickly undo one’s design. We hypothesize that the proposed platform could confer a number of important benefits to learners. For example, it may 1) enable younger learners to participate in Minecraft experiences, 2) accelerate the development of spatial reasoning skills through the faster design cycles, 3) provide a naturalistic means for which students can learn computational thinking, and 4) allows students to be more cognitively engaged in developing the macro-level structures and re
Status | Finished |
---|---|
Effective start/end date | 9/1/18 → 8/31/22 |
Funding
- National Science Foundation (IIS-1822865-002)
Fingerprint
Explore the research topics touched on by this project. These labels are generated based on the underlying awards/grants. Together they form a unique fingerprint.