Abstract
Sketching is a powerful means of interpersonal communication. While many useful multimodal systems have been created, current systems are far from achieving human-like participation in sketching. A computational model of sketching would help characterize these differences and help us better understand how to overcome them. This paper is a first step towards such a model. We start with an example of a sketching system (nuSketch COA Creator) designed to aid military planners, to provide context and a source of examples. We then describe four dimensions of sketching, visual understanding, conceptual understanding, language understanding, and drawing, that can be used to characterize the competence of existing systems and identify open problems. The issues involved will be illustrated by examples from our experience with nuSketch. Three research challenges are posed, to serve as milestones towards a computational model of sketching that can explain and replicate human abilities in this area.
| Original language | English (US) |
|---|---|
| Title of host publication | International Conference on Intelligent User Interfaces, Proceedings IUI |
| Pages | 77-83 |
| Number of pages | 7 |
| State | Published - Jan 1 2001 |
| Event | 2001 International Conference on Intelligent User Interfaces (IUI 2001) - Santa Fe, NM, United States Duration: Jan 14 2001 → Jan 17 2001 |
Other
| Other | 2001 International Conference on Intelligent User Interfaces (IUI 2001) |
|---|---|
| Country/Territory | United States |
| City | Santa Fe, NM |
| Period | 1/14/01 → 1/17/01 |
Keywords
- Intelligent front-ends to knowledge-based systems
- Multimodal interfaces
- Sketching
ASJC Scopus subject areas
- General Computer Science