Visual panel: Virtual mouse, keyboard and 3D controller with an ordinary piece of paper

Zhengyou Zhang, Ying Wu, Ying Shan, Steven Shafer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Scopus citations

Abstract

This paper presents a vision-based interface system, VISUAL PANEL, which employs an arbitrary quadrangle-shaped panel (e.g., an ordinary piece of paper) and a tip pointer (e.g., fingertip) as an intuitive, wireless and mobile input device. The system can accurately and reliably track the panel and the tip pointer. The panel tracking continuously determines the projective mapping between the panel at the current position and the display, which in turn maps the tip position to the corresponding position on the display. By detecting the clicking and dragging actions, the system can fulfill many tasks such as controlling a remote large display, and simulating a physical keyboard. Users can naturally use their fingers or other tip pointers to issue commands and type texts. Furthermore, by tracking the 3D position and orientation of the visual panel, the system can also provide 3D information, serving as a virtual joystick, to control 3D virtual objects.

Original languageEnglish (US)
Title of host publicationProceedings of the 2001 Workshop on Perceptive User Interfaces, PUI 2001
PublisherAssociation for Computing Machinery
Number of pages1
ISBN (Electronic)1581134487
DOIs
StatePublished - Nov 15 2001
Event2001 Workshop on Perceptive User Interfaces, PUI 2001 - Orlando, United States
Duration: Nov 15 2001Nov 16 2001

Publication series

NameACM International Conference Proceeding Series
Volume15-16-November-2001

Other

Other2001 Workshop on Perceptive User Interfaces, PUI 2001
CountryUnited States
CityOrlando
Period11/15/0111/16/01

Keywords

  • New control device
  • New input device
  • Plane projectivity
  • Virtual joystick
  • Virtual keyboard
  • Virtual mouse
  • Vision-based user interface
  • Visual panel

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Visual panel: Virtual mouse, keyboard and 3D controller with an ordinary piece of paper'. Together they form a unique fingerprint.

  • Cite this

    Zhang, Z., Wu, Y., Shan, Y., & Shafer, S. (2001). Visual panel: Virtual mouse, keyboard and 3D controller with an ordinary piece of paper. In Proceedings of the 2001 Workshop on Perceptive User Interfaces, PUI 2001 (ACM International Conference Proceeding Series; Vol. 15-16-November-2001). Association for Computing Machinery. https://doi.org/10.1145/971478.971522