Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems

Luke E. Osborn; Breanne Christie; Adam C.G. Crego; Dayann D'Almeida; David P. McMullen; Robert W. Nickl; Ambarish S. Pawar; Jeremy D. Brown; Brock A. Wester; Chaz Firestone; Pablo A. Celnik; Matthew S. Fifer; Francesco V. Tenore

doi:10.1109/NER52421.2023.10123891

Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems

Luke E. Osborn^*, Breanne Christie, Adam C.G. Crego, Dayann D'Almeida, David P. McMullen, Robert W. Nickl, Ambarish S. Pawar, Jeremy D. Brown, Brock A. Wester, Chaz Firestone, Pablo A. Celnik, Matthew S. Fifer, Francesco V. Tenore

^*Corresponding author for this work

Physical Medicine and Rehabilitation

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

Complete sensorimotor integration and user acceptance of a neural prosthesis relies on system embodiment - the incorporation of an external system into one's own body schema and representation. Embodiment of neural prostheses is an ambiguous concept with limited approaches for quantifying human and machine integration in a meaningful way. In an attempt to understand human sensory integration with external systems, we measured neural activity in the somatosensory cortex of a participant with chronically implanted microelectrode arrays during sensory events tied to either a virtual robotic hand touching an object or a virtual lamp lighting up. Sensory stimulation was delivered using either skin vibration or intracortical microstimulation (ICMS) and was mapped to the virtual systems. Through the brain-machine interface, we observed quantifiable cortical activity corresponding to tactile sensations perceived during the virtual tasks and even during instances when neural stimulation was expected but not delivered, demonstrating the presence of sensory-related neural activity even in the absence of tactile stimulation. Evoked sensory expectation signals were also observed in the motor cortex, although at reduced amplitudes. Evoked cortical activity corresponding to expectation of a sensory input could serve as objective cortical markers for better understanding sensori-motor integration and perceptual experiences when connecting humans with external systems.

Original language	English (US)
Title of host publication	11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings
Publisher	IEEE Computer Society
ISBN (Electronic)	9781665462921
DOIs	https://doi.org/10.1109/NER52421.2023.10123891
State	Published - 2023
Event	11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Baltimore, United States Duration: Apr 25 2023 → Apr 27 2023

Publication series

Name	International IEEE/EMBS Conference on Neural Engineering, NER
Volume	2023-April
ISSN (Print)	1948-3546
ISSN (Electronic)	1948-3554

Conference

Conference	11th International IEEE/EMBS Conference on Neural Engineering, NER 2023
Country/Territory	United States
City	Baltimore
Period	4/25/23 → 4/27/23

Funding

The authors thank the participant for their time spent on this study. This research was developed with funding from the Johns Hopkins University Applied Physics Laboratory (JHU/APL). Experimental infrastructure was enabled by previous funding from the Defense Advanced Research Projects Agency (DARPA). The views, opinions and/or findings expressed are those of the authors and should not be interpreted as representing the official views or policies of the Department of Defense or the U.S. Government. 1Johns Hopkins University Applied Physics Laboratory 2National Institute of Mental Health, National Institutes of Health 3Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine 4Department of Mechanical Engineering, Johns Hopkins University 5Department of Cognitive Science, Johns Hopkins University correspondance: [email protected]

ASJC Scopus subject areas

Artificial Intelligence
Mechanical Engineering

Access to Document

10.1109/NER52421.2023.10123891

Cite this

Osborn, L. E., Christie, B., Crego, A. C. G., D'Almeida, D., McMullen, D. P., Nickl, R. W., Pawar, A. S., Brown, J. D., Wester, B. A., Firestone, C., Celnik, P. A., Fifer, M. S., & Tenore, F. V. (2023). Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems. In 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings (International IEEE/EMBS Conference on Neural Engineering, NER; Vol. 2023-April). IEEE Computer Society. https://doi.org/10.1109/NER52421.2023.10123891

@inproceedings{179c82c8476647d4a4e35a0e98c13ca2,

title = "Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems",

abstract = "Complete sensorimotor integration and user acceptance of a neural prosthesis relies on system embodiment - the incorporation of an external system into one's own body schema and representation. Embodiment of neural prostheses is an ambiguous concept with limited approaches for quantifying human and machine integration in a meaningful way. In an attempt to understand human sensory integration with external systems, we measured neural activity in the somatosensory cortex of a participant with chronically implanted microelectrode arrays during sensory events tied to either a virtual robotic hand touching an object or a virtual lamp lighting up. Sensory stimulation was delivered using either skin vibration or intracortical microstimulation (ICMS) and was mapped to the virtual systems. Through the brain-machine interface, we observed quantifiable cortical activity corresponding to tactile sensations perceived during the virtual tasks and even during instances when neural stimulation was expected but not delivered, demonstrating the presence of sensory-related neural activity even in the absence of tactile stimulation. Evoked sensory expectation signals were also observed in the motor cortex, although at reduced amplitudes. Evoked cortical activity corresponding to expectation of a sensory input could serve as objective cortical markers for better understanding sensori-motor integration and perceptual experiences when connecting humans with external systems.",

author = "Osborn, {Luke E.} and Breanne Christie and Crego, {Adam C.G.} and Dayann D'Almeida and McMullen, {David P.} and Nickl, {Robert W.} and Pawar, {Ambarish S.} and Brown, {Jeremy D.} and Wester, {Brock A.} and Chaz Firestone and Celnik, {Pablo A.} and Fifer, {Matthew S.} and Tenore, {Francesco V.}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 ; Conference date: 25-04-2023 Through 27-04-2023",

year = "2023",

doi = "10.1109/NER52421.2023.10123891",

language = "English (US)",

series = "International IEEE/EMBS Conference on Neural Engineering, NER",

publisher = "IEEE Computer Society",

booktitle = "11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings",

address = "United States",

}

Osborn, LE, Christie, B, Crego, ACG, D'Almeida, D, McMullen, DP, Nickl, RW, Pawar, AS, Brown, JD, Wester, BA, Firestone, C, Celnik, PA, Fifer, MS & Tenore, FV 2023, Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems. in 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings. International IEEE/EMBS Conference on Neural Engineering, NER, vol. 2023-April, IEEE Computer Society, 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023, Baltimore, United States, 4/25/23. https://doi.org/10.1109/NER52421.2023.10123891

Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems. / Osborn, Luke E.; Christie, Breanne; Crego, Adam C.G. et al.
11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings. IEEE Computer Society, 2023. (International IEEE/EMBS Conference on Neural Engineering, NER; Vol. 2023-April).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems

AU - Osborn, Luke E.

AU - Christie, Breanne

AU - Crego, Adam C.G.

AU - D'Almeida, Dayann

AU - McMullen, David P.

AU - Nickl, Robert W.

AU - Pawar, Ambarish S.

AU - Brown, Jeremy D.

AU - Wester, Brock A.

AU - Firestone, Chaz

AU - Celnik, Pablo A.

AU - Fifer, Matthew S.

AU - Tenore, Francesco V.

PY - 2023

Y1 - 2023

N2 - Complete sensorimotor integration and user acceptance of a neural prosthesis relies on system embodiment - the incorporation of an external system into one's own body schema and representation. Embodiment of neural prostheses is an ambiguous concept with limited approaches for quantifying human and machine integration in a meaningful way. In an attempt to understand human sensory integration with external systems, we measured neural activity in the somatosensory cortex of a participant with chronically implanted microelectrode arrays during sensory events tied to either a virtual robotic hand touching an object or a virtual lamp lighting up. Sensory stimulation was delivered using either skin vibration or intracortical microstimulation (ICMS) and was mapped to the virtual systems. Through the brain-machine interface, we observed quantifiable cortical activity corresponding to tactile sensations perceived during the virtual tasks and even during instances when neural stimulation was expected but not delivered, demonstrating the presence of sensory-related neural activity even in the absence of tactile stimulation. Evoked sensory expectation signals were also observed in the motor cortex, although at reduced amplitudes. Evoked cortical activity corresponding to expectation of a sensory input could serve as objective cortical markers for better understanding sensori-motor integration and perceptual experiences when connecting humans with external systems.

AB - Complete sensorimotor integration and user acceptance of a neural prosthesis relies on system embodiment - the incorporation of an external system into one's own body schema and representation. Embodiment of neural prostheses is an ambiguous concept with limited approaches for quantifying human and machine integration in a meaningful way. In an attempt to understand human sensory integration with external systems, we measured neural activity in the somatosensory cortex of a participant with chronically implanted microelectrode arrays during sensory events tied to either a virtual robotic hand touching an object or a virtual lamp lighting up. Sensory stimulation was delivered using either skin vibration or intracortical microstimulation (ICMS) and was mapped to the virtual systems. Through the brain-machine interface, we observed quantifiable cortical activity corresponding to tactile sensations perceived during the virtual tasks and even during instances when neural stimulation was expected but not delivered, demonstrating the presence of sensory-related neural activity even in the absence of tactile stimulation. Evoked sensory expectation signals were also observed in the motor cortex, although at reduced amplitudes. Evoked cortical activity corresponding to expectation of a sensory input could serve as objective cortical markers for better understanding sensori-motor integration and perceptual experiences when connecting humans with external systems.

UR - http://www.scopus.com/inward/record.url?scp=85160601591&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85160601591&partnerID=8YFLogxK

U2 - 10.1109/NER52421.2023.10123891

DO - 10.1109/NER52421.2023.10123891

M3 - Conference contribution

AN - SCOPUS:85160601591

T3 - International IEEE/EMBS Conference on Neural Engineering, NER

BT - 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings

PB - IEEE Computer Society

T2 - 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023

Y2 - 25 April 2023 through 27 April 2023

ER -

Osborn LE, Christie B, Crego ACG, D'Almeida D, McMullen DP, Nickl RW et al. Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems. In 11th International IEEE/EMBS Conference on Neural Engineering, NER 2023 - Proceedings. IEEE Computer Society. 2023. (International IEEE/EMBS Conference on Neural Engineering, NER). doi: 10.1109/NER52421.2023.10123891

Cortical Response to Expectation of Tactile Stimulation from External Anthropomorphic and Non-Anthropomorphic Systems

Abstract

Publication series

Conference

Funding

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this