Sketching as a modality in intelligent tutoring systems

The Spatial Intelligence and Learning Center (SILC) pioneered the idea of spatial learning: improving learning about spatial concepts and using spatial concepts to facilitate learning about other domains. Spatial concepts are of significant importance in Science, Technology, Engineering and Mathematics (STEM) education including physics, chemistry, geoscience, and biology, as well as most branches of engineering. Spatial concepts are also important in the military. For example, sand tables are used to understand the terrain, since calculating Line of Sight (LOS) for cover and concealment on the battlefield can mean the difference between life or death. In addition, land navigation using topographic maps is a critical skill that all members of the military are required to obtain. For this work in progress, the Army Research Laboratory (ARL) and Northwestern University, a member of SILC, are exploring sketching technologies to support spatial learning, as part of on-going research in adaptive training technologies. ARL’s Generalized Intelligent Framework for Tutoring (GIFT) provides a software platform for developing intelligent tutoring systems. Adaptive learning, where the state of the learner is used to help select their path through activities, has been shown to improve learning. As part of our on-going research, we are in the process of integrating sketch worksheets into GIFT as a new type of instructional media. Sketch worksheets were designed to be general-purpose and use artificial intelligence to provide immediate feedback to students performing sketching assignments. To facilitate dissemination, an authoring environment was created for domain experts and instructors, to enable them to create new worksheets. This poster describes a work in progress to bring together the two lines of research to support the use of sketching in an adaptive learning environment.