Conveying the configuration of a virtual human hand using vibrotactile feedback

Andrew Cheng*, Kirk A. Nichols, Heidi M. Weeks, Netta Gurari, Allison M. Okamura

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

Upper-limb prostheses users lack proprioception of their artificial arm, and rely heavily on vision to understand its configuration. With the goal of reducing the amount of energy expended on visual cues during upper-limb prosthesis use, this study investigates whether haptic feedback can relay the configuration of a virtual hand in the absence of sight. Two mappings from waistbelt-mounted tactor vibration patterns to hand configuration are explored: (1) Synergy-based hand motions derived from the results of a principal component analysis run on an aggregate of hand motions and (2) Decoupled hand motions, which include experimenter-selected motions such as finger grasp and finger spread. Results show that users can identify complex hand configurations with vibrotactile feedback patterns based on both the Synergies and Decoupled methods, although 30-45 seconds are required to achieve this task. Also, findings demonstrate that users are likely to memorize correspondence between an overall feeling of the tactor pattern to a hand configuration rather than constructing the hand configuration by isolating and considering each tactor individually. Last, results indicate that hand configuration is most accurately conveyed by maximizing information along a synergy-based space.

Original languageEnglish (US)
Title of host publicationHaptics Symposium 2012, HAPTICS 2012 - Proceedings
Pages155-162
Number of pages8
DOIs
StatePublished - May 15 2012
Event2012 IEEE Haptics Symposium, HAPTICS 2012 - Vancouver, BC, Canada
Duration: Mar 4 2012Mar 7 2012

Publication series

NameHaptics Symposium 2012, HAPTICS 2012 - Proceedings

Other

Other2012 IEEE Haptics Symposium, HAPTICS 2012
CountryCanada
CityVancouver, BC
Period3/4/123/7/12

Fingerprint

Conveying
Feedback
Prosthetics
Principal component analysis
Prostheses and Implants

Keywords

  • Hand Synergies
  • Haptic Feedback
  • Prosthetics
  • Sensory Substitution
  • Vibrotactile Feedback

ASJC Scopus subject areas

  • Human-Computer Interaction

Cite this

Cheng, A., Nichols, K. A., Weeks, H. M., Gurari, N., & Okamura, A. M. (2012). Conveying the configuration of a virtual human hand using vibrotactile feedback. In Haptics Symposium 2012, HAPTICS 2012 - Proceedings (pp. 155-162). [6183784] (Haptics Symposium 2012, HAPTICS 2012 - Proceedings). https://doi.org/10.1109/HAPTIC.2012.6183784
Cheng, Andrew ; Nichols, Kirk A. ; Weeks, Heidi M. ; Gurari, Netta ; Okamura, Allison M. / Conveying the configuration of a virtual human hand using vibrotactile feedback. Haptics Symposium 2012, HAPTICS 2012 - Proceedings. 2012. pp. 155-162 (Haptics Symposium 2012, HAPTICS 2012 - Proceedings).
@inproceedings{f34f31ea57f643d79a044d07ad1eff7a,
title = "Conveying the configuration of a virtual human hand using vibrotactile feedback",
abstract = "Upper-limb prostheses users lack proprioception of their artificial arm, and rely heavily on vision to understand its configuration. With the goal of reducing the amount of energy expended on visual cues during upper-limb prosthesis use, this study investigates whether haptic feedback can relay the configuration of a virtual hand in the absence of sight. Two mappings from waistbelt-mounted tactor vibration patterns to hand configuration are explored: (1) Synergy-based hand motions derived from the results of a principal component analysis run on an aggregate of hand motions and (2) Decoupled hand motions, which include experimenter-selected motions such as finger grasp and finger spread. Results show that users can identify complex hand configurations with vibrotactile feedback patterns based on both the Synergies and Decoupled methods, although 30-45 seconds are required to achieve this task. Also, findings demonstrate that users are likely to memorize correspondence between an overall feeling of the tactor pattern to a hand configuration rather than constructing the hand configuration by isolating and considering each tactor individually. Last, results indicate that hand configuration is most accurately conveyed by maximizing information along a synergy-based space.",
keywords = "Hand Synergies, Haptic Feedback, Prosthetics, Sensory Substitution, Vibrotactile Feedback",
author = "Andrew Cheng and Nichols, {Kirk A.} and Weeks, {Heidi M.} and Netta Gurari and Okamura, {Allison M.}",
year = "2012",
month = "5",
day = "15",
doi = "10.1109/HAPTIC.2012.6183784",
language = "English (US)",
isbn = "9781467308090",
series = "Haptics Symposium 2012, HAPTICS 2012 - Proceedings",
pages = "155--162",
booktitle = "Haptics Symposium 2012, HAPTICS 2012 - Proceedings",

}

Cheng, A, Nichols, KA, Weeks, HM, Gurari, N & Okamura, AM 2012, Conveying the configuration of a virtual human hand using vibrotactile feedback. in Haptics Symposium 2012, HAPTICS 2012 - Proceedings., 6183784, Haptics Symposium 2012, HAPTICS 2012 - Proceedings, pp. 155-162, 2012 IEEE Haptics Symposium, HAPTICS 2012, Vancouver, BC, Canada, 3/4/12. https://doi.org/10.1109/HAPTIC.2012.6183784

Conveying the configuration of a virtual human hand using vibrotactile feedback. / Cheng, Andrew; Nichols, Kirk A.; Weeks, Heidi M.; Gurari, Netta; Okamura, Allison M.

Haptics Symposium 2012, HAPTICS 2012 - Proceedings. 2012. p. 155-162 6183784 (Haptics Symposium 2012, HAPTICS 2012 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Conveying the configuration of a virtual human hand using vibrotactile feedback

AU - Cheng, Andrew

AU - Nichols, Kirk A.

AU - Weeks, Heidi M.

AU - Gurari, Netta

AU - Okamura, Allison M.

PY - 2012/5/15

Y1 - 2012/5/15

N2 - Upper-limb prostheses users lack proprioception of their artificial arm, and rely heavily on vision to understand its configuration. With the goal of reducing the amount of energy expended on visual cues during upper-limb prosthesis use, this study investigates whether haptic feedback can relay the configuration of a virtual hand in the absence of sight. Two mappings from waistbelt-mounted tactor vibration patterns to hand configuration are explored: (1) Synergy-based hand motions derived from the results of a principal component analysis run on an aggregate of hand motions and (2) Decoupled hand motions, which include experimenter-selected motions such as finger grasp and finger spread. Results show that users can identify complex hand configurations with vibrotactile feedback patterns based on both the Synergies and Decoupled methods, although 30-45 seconds are required to achieve this task. Also, findings demonstrate that users are likely to memorize correspondence between an overall feeling of the tactor pattern to a hand configuration rather than constructing the hand configuration by isolating and considering each tactor individually. Last, results indicate that hand configuration is most accurately conveyed by maximizing information along a synergy-based space.

AB - Upper-limb prostheses users lack proprioception of their artificial arm, and rely heavily on vision to understand its configuration. With the goal of reducing the amount of energy expended on visual cues during upper-limb prosthesis use, this study investigates whether haptic feedback can relay the configuration of a virtual hand in the absence of sight. Two mappings from waistbelt-mounted tactor vibration patterns to hand configuration are explored: (1) Synergy-based hand motions derived from the results of a principal component analysis run on an aggregate of hand motions and (2) Decoupled hand motions, which include experimenter-selected motions such as finger grasp and finger spread. Results show that users can identify complex hand configurations with vibrotactile feedback patterns based on both the Synergies and Decoupled methods, although 30-45 seconds are required to achieve this task. Also, findings demonstrate that users are likely to memorize correspondence between an overall feeling of the tactor pattern to a hand configuration rather than constructing the hand configuration by isolating and considering each tactor individually. Last, results indicate that hand configuration is most accurately conveyed by maximizing information along a synergy-based space.

KW - Hand Synergies

KW - Haptic Feedback

KW - Prosthetics

KW - Sensory Substitution

KW - Vibrotactile Feedback

UR - http://www.scopus.com/inward/record.url?scp=84860817109&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860817109&partnerID=8YFLogxK

U2 - 10.1109/HAPTIC.2012.6183784

DO - 10.1109/HAPTIC.2012.6183784

M3 - Conference contribution

AN - SCOPUS:84860817109

SN - 9781467308090

T3 - Haptics Symposium 2012, HAPTICS 2012 - Proceedings

SP - 155

EP - 162

BT - Haptics Symposium 2012, HAPTICS 2012 - Proceedings

ER -

Cheng A, Nichols KA, Weeks HM, Gurari N, Okamura AM. Conveying the configuration of a virtual human hand using vibrotactile feedback. In Haptics Symposium 2012, HAPTICS 2012 - Proceedings. 2012. p. 155-162. 6183784. (Haptics Symposium 2012, HAPTICS 2012 - Proceedings). https://doi.org/10.1109/HAPTIC.2012.6183784