Bioelastic state recovery for haptic sensory substitution

Matthew T. Flavin; Kyoung Ho Ha; Zengrong Guo; Shupeng Li; Jin Tae Kim; Tara Saxena; Dimitrios Simatos; Fatimah Al-Najjar; Yuxuan Mao; Shishir Bandapalli; Chengye Fan; Dongjun Bai; Zhuang Zhang; Yanlin Zhang; Eunhye Flavin; Kenneth E. Madsen; Yi Huang; Luoqian Emu; Jingyang Zhao; Jae Young Yoo; Minsu Park; Jaeho Shin; Aaron G. Huang; Hee Sup Shin; J. Edward Colgate; Yonggang Huang; Zhaoqian Xie; Hanqing Jiang; John A. Rogers

doi:10.1038/s41586-024-08155-9

Bioelastic state recovery for haptic sensory substitution

Matthew T. Flavin, Kyoung Ho Ha, Zengrong Guo, Shupeng Li, Jin Tae Kim, Tara Saxena, Dimitrios Simatos, Fatimah Al-Najjar, Yuxuan Mao, Shishir Bandapalli, Chengye Fan, Dongjun Bai, Zhuang Zhang, Yanlin Zhang, Eunhye Flavin, Kenneth E. Madsen, Yi Huang, Luoqian Emu, Jingyang Zhao, Jae Young YooMinsu Park, Jaeho Shin, Aaron G. Huang, Hee Sup Shin, J. Edward Colgate, Yonggang Huang^*, Zhaoqian Xie^*, Hanqing Jiang^*, John A. Rogers^*

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract

The rich set of mechanoreceptors found in human skin^1,2 offers a versatile engineering interface for transmitting information and eliciting perceptions^3,4, potentially serving a broad range of applications in patient care⁵ and other important industries^6,7. Targeted multisensory engagement of these afferent units, however, faces persistent challenges, especially for wearable, programmable systems that need to operate adaptively across the body^8–11. Here we present a miniaturized electromechanical structure that, when combined with skin as an elastic, energy-storing element, supports bistable, self-sensing modes of deformation. Targeting specific classes of mechanoreceptors as the basis for distinct, programmed sensory responses, this haptic unit can deliver both dynamic and static stimuli, directed as either normal or shear forces. Systematic experimental and theoretical studies establish foundational principles and practical criteria for low-energy operation across natural anatomical variations in the mechanical properties of human skin. A wireless, skin-conformable haptic interface, integrating an array of these bistable transducers, serves as a high-density channel capable of rendering input from smartphone-based 3D scanning and inertial sensors. Demonstrations of this system include sensory substitution designed to improve the quality of life for patients with visual and proprioceptive impairments.

Original language	English (US)
Pages (from-to)	345-352
Number of pages	8
Journal	Nature
Volume	635
Issue number	8038
DOIs	https://doi.org/10.1038/s41586-024-08155-9
State	Published - Nov 14 2024
Externally published	Yes

Funding

M.F. acknowledges support from the National Institutes of Health (grant T32HL007909). H.J. acknowledges support from the National Natural Science Foundations of China (grant 12350003). H.J. and Z.G. thank the Research Center for Industries of the Future (RCIF) at Westlake University and Westlake Education Foundation for supporting this work. Z.X. acknowledges the support from the National Natural Science Foundation of China (grants 12472160 and\u00A012072057), Liaoning Revitalization Talents Program (grant XLYC2007196) and Dalian Outstanding Young Talents in Science and Technology (grant 2021RJ06). We also thank R. Golemia and T. Bui from the machine shop at Northwestern University for CNC lathe and wire electrical discharge machining fabrication. M.F. acknowledges support from the National Institutes of Health (grant T32HL007909). H.J. acknowledges support from the National Natural Science Foundations of China (grant 12350003). H.J. and Z.G. thank the Research Center for Industries of the Future (RCIF) at Westlake University and Westlake Education Foundation for supporting this work. Z.X. acknowledges the support from the National Natural Science Foundation of China (grants 12472160 and 12072057), Liaoning Revitalization Talents Program (grant XLYC2007196) and Dalian Outstanding Young Talents in Science and Technology (grant 2021RJ06). We also thank R. Golemia and T. Bui from the machine shop at Northwestern University for CNC lathe and wire electrical discharge machining fabrication.

ASJC Scopus subject areas

General

Access to Document

10.1038/s41586-024-08155-9

Cite this

Flavin, M. T., Ha, K. H., Guo, Z., Li, S., Kim, J. T., Saxena, T., Simatos, D., Al-Najjar, F., Mao, Y., Bandapalli, S., Fan, C., Bai, D., Zhang, Z., Zhang, Y., Flavin, E., Madsen, K. E., Huang, Y., Emu, L., Zhao, J., ... Rogers, J. A. (2024). Bioelastic state recovery for haptic sensory substitution. Nature, 635(8038), 345-352. https://doi.org/10.1038/s41586-024-08155-9

@article{80ebde8f7c7845ccac1c737ffb9bb23e,

title = "Bioelastic state recovery for haptic sensory substitution",

abstract = "The rich set of mechanoreceptors found in human skin1,2 offers a versatile engineering interface for transmitting information and eliciting perceptions3,4, potentially serving a broad range of applications in patient care5 and other important industries6,7. Targeted multisensory engagement of these afferent units, however, faces persistent challenges, especially for wearable, programmable systems that need to operate adaptively across the body8–11. Here we present a miniaturized electromechanical structure that, when combined with skin as an elastic, energy-storing element, supports bistable, self-sensing modes of deformation. Targeting specific classes of mechanoreceptors as the basis for distinct, programmed sensory responses, this haptic unit can deliver both dynamic and static stimuli, directed as either normal or shear forces. Systematic experimental and theoretical studies establish foundational principles and practical criteria for low-energy operation across natural anatomical variations in the mechanical properties of human skin. A wireless, skin-conformable haptic interface, integrating an array of these bistable transducers, serves as a high-density channel capable of rendering input from smartphone-based 3D scanning and inertial sensors. Demonstrations of this system include sensory substitution designed to improve the quality of life for patients with visual and proprioceptive impairments.",

author = "Flavin, {Matthew T.} and Ha, {Kyoung Ho} and Zengrong Guo and Shupeng Li and Kim, {Jin Tae} and Tara Saxena and Dimitrios Simatos and Fatimah Al-Najjar and Yuxuan Mao and Shishir Bandapalli and Chengye Fan and Dongjun Bai and Zhuang Zhang and Yanlin Zhang and Eunhye Flavin and Madsen, {Kenneth E.} and Yi Huang and Luoqian Emu and Jingyang Zhao and Yoo, {Jae Young} and Minsu Park and Jaeho Shin and Huang, {Aaron G.} and Shin, {Hee Sup} and Colgate, {J. Edward} and Yonggang Huang and Zhaoqian Xie and Hanqing Jiang and Rogers, {John A.}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive licence to Springer Nature Limited 2024.",

year = "2024",

month = nov,

day = "14",

doi = "10.1038/s41586-024-08155-9",

language = "English (US)",

volume = "635",

pages = "345--352",

journal = "Nature",

issn = "0028-0836",

publisher = "Nature Research",

number = "8038",

}

Flavin, MT, Ha, KH, Guo, Z, Li, S, Kim, JT, Saxena, T, Simatos, D, Al-Najjar, F, Mao, Y, Bandapalli, S, Fan, C, Bai, D, Zhang, Z, Zhang, Y, Flavin, E, Madsen, KE, Huang, Y, Emu, L, Zhao, J, Yoo, JY, Park, M, Shin, J, Huang, AG, Shin, HS, Colgate, JE , Huang, Y, Xie, Z, Jiang, H & Rogers, JA 2024, 'Bioelastic state recovery for haptic sensory substitution', Nature, vol. 635, no. 8038, pp. 345-352. https://doi.org/10.1038/s41586-024-08155-9

TY - JOUR

T1 - Bioelastic state recovery for haptic sensory substitution

AU - Flavin, Matthew T.

AU - Ha, Kyoung Ho

AU - Guo, Zengrong

AU - Li, Shupeng

AU - Kim, Jin Tae

AU - Saxena, Tara

AU - Simatos, Dimitrios

AU - Al-Najjar, Fatimah

AU - Mao, Yuxuan

AU - Bandapalli, Shishir

AU - Fan, Chengye

AU - Bai, Dongjun

AU - Zhang, Zhuang

AU - Zhang, Yanlin

AU - Flavin, Eunhye

AU - Madsen, Kenneth E.

AU - Huang, Yi

AU - Emu, Luoqian

AU - Zhao, Jingyang

AU - Yoo, Jae Young

AU - Park, Minsu

AU - Shin, Jaeho

AU - Huang, Aaron G.

AU - Shin, Hee Sup

AU - Colgate, J. Edward

AU - Huang, Yonggang

AU - Xie, Zhaoqian

AU - Jiang, Hanqing

AU - Rogers, John A.

PY - 2024/11/14

Y1 - 2024/11/14

N2 - The rich set of mechanoreceptors found in human skin1,2 offers a versatile engineering interface for transmitting information and eliciting perceptions3,4, potentially serving a broad range of applications in patient care5 and other important industries6,7. Targeted multisensory engagement of these afferent units, however, faces persistent challenges, especially for wearable, programmable systems that need to operate adaptively across the body8–11. Here we present a miniaturized electromechanical structure that, when combined with skin as an elastic, energy-storing element, supports bistable, self-sensing modes of deformation. Targeting specific classes of mechanoreceptors as the basis for distinct, programmed sensory responses, this haptic unit can deliver both dynamic and static stimuli, directed as either normal or shear forces. Systematic experimental and theoretical studies establish foundational principles and practical criteria for low-energy operation across natural anatomical variations in the mechanical properties of human skin. A wireless, skin-conformable haptic interface, integrating an array of these bistable transducers, serves as a high-density channel capable of rendering input from smartphone-based 3D scanning and inertial sensors. Demonstrations of this system include sensory substitution designed to improve the quality of life for patients with visual and proprioceptive impairments.

AB - The rich set of mechanoreceptors found in human skin1,2 offers a versatile engineering interface for transmitting information and eliciting perceptions3,4, potentially serving a broad range of applications in patient care5 and other important industries6,7. Targeted multisensory engagement of these afferent units, however, faces persistent challenges, especially for wearable, programmable systems that need to operate adaptively across the body8–11. Here we present a miniaturized electromechanical structure that, when combined with skin as an elastic, energy-storing element, supports bistable, self-sensing modes of deformation. Targeting specific classes of mechanoreceptors as the basis for distinct, programmed sensory responses, this haptic unit can deliver both dynamic and static stimuli, directed as either normal or shear forces. Systematic experimental and theoretical studies establish foundational principles and practical criteria for low-energy operation across natural anatomical variations in the mechanical properties of human skin. A wireless, skin-conformable haptic interface, integrating an array of these bistable transducers, serves as a high-density channel capable of rendering input from smartphone-based 3D scanning and inertial sensors. Demonstrations of this system include sensory substitution designed to improve the quality of life for patients with visual and proprioceptive impairments.

UR - http://www.scopus.com/inward/record.url?scp=85208479942&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85208479942&partnerID=8YFLogxK

U2 - 10.1038/s41586-024-08155-9

DO - 10.1038/s41586-024-08155-9

M3 - Article

C2 - 39506124

AN - SCOPUS:85208479942

SN - 0028-0836

VL - 635

SP - 345

EP - 352

JO - Nature

JF - Nature

IS - 8038

ER -

Bioelastic state recovery for haptic sensory substitution

Abstract

Funding

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this