Decoding of articulatory gestures during word production using speech motor and premotor cortical activity

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Brain-machine interfaces that directly translate attempted speech from the speech motor areas could change the lives of people with complete paralysis. However, it remains uncertain exactly how speech production is encoded in cortex. Improving this understanding could greatly improve brain-machine interface design. Specifically, it is not clear to what extent the different levels of speech production (phonemes, or speech sounds, and articulatory gestures, which describe the movements of the articulator muscles) are represented in the motor cortex. Using electrocorticographic (ECoG) electrodes on the cortical surface, we recorded neural activity from speech motor and premotor areas during speech production. We decoded both gestures and phonemes using the neural signals. Overall classification accuracy was higher for gestures than phonemes. In particular, gestures were better represented in the primary sensorimotor cortices, while phonemes were better represented in more anterior areas.

Original languageEnglish (US)
Title of host publication2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5339-5342
Number of pages4
ISBN (Electronic)9781424492718
DOIs
StatePublished - Nov 4 2015
Event37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy
Duration: Aug 25 2015Aug 29 2015

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2015-November
ISSN (Print)1557-170X

Other

Other37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
CountryItaly
CityMilan
Period8/25/158/29/15

Fingerprint

Gestures
Decoding
Motor Cortex
Brain-Computer Interfaces
Brain
Dental Articulators
Phonetics
Paralysis
Electrodes
Muscle
Muscles
Acoustic waves

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Cite this

Mugler, E. M., Goldrick, M., Rosenow, J. M., Tate, M. C., & Slutzky, M. W. (2015). Decoding of articulatory gestures during word production using speech motor and premotor cortical activity. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 (pp. 5339-5342). [7319597] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7319597
Mugler, Emily M. ; Goldrick, Matthew ; Rosenow, Joshua M. ; Tate, Matthew C. ; Slutzky, Marc W. / Decoding of articulatory gestures during word production using speech motor and premotor cortical activity. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 5339-5342 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).
@inproceedings{9c52e0eb8c65454188fe96970288a8a7,
title = "Decoding of articulatory gestures during word production using speech motor and premotor cortical activity",
abstract = "Brain-machine interfaces that directly translate attempted speech from the speech motor areas could change the lives of people with complete paralysis. However, it remains uncertain exactly how speech production is encoded in cortex. Improving this understanding could greatly improve brain-machine interface design. Specifically, it is not clear to what extent the different levels of speech production (phonemes, or speech sounds, and articulatory gestures, which describe the movements of the articulator muscles) are represented in the motor cortex. Using electrocorticographic (ECoG) electrodes on the cortical surface, we recorded neural activity from speech motor and premotor areas during speech production. We decoded both gestures and phonemes using the neural signals. Overall classification accuracy was higher for gestures than phonemes. In particular, gestures were better represented in the primary sensorimotor cortices, while phonemes were better represented in more anterior areas.",
author = "Mugler, {Emily M.} and Matthew Goldrick and Rosenow, {Joshua M.} and Tate, {Matthew C.} and Slutzky, {Marc W.}",
year = "2015",
month = "11",
day = "4",
doi = "10.1109/EMBC.2015.7319597",
language = "English (US)",
series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "5339--5342",
booktitle = "2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015",
address = "United States",

}

Mugler, EM, Goldrick, M, Rosenow, JM, Tate, MC & Slutzky, MW 2015, Decoding of articulatory gestures during word production using speech motor and premotor cortical activity. in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015., 7319597, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, vol. 2015-November, Institute of Electrical and Electronics Engineers Inc., pp. 5339-5342, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 8/25/15. https://doi.org/10.1109/EMBC.2015.7319597

Decoding of articulatory gestures during word production using speech motor and premotor cortical activity. / Mugler, Emily M.; Goldrick, Matthew; Rosenow, Joshua M.; Tate, Matthew C.; Slutzky, Marc W.

2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 5339-5342 7319597 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Decoding of articulatory gestures during word production using speech motor and premotor cortical activity

AU - Mugler, Emily M.

AU - Goldrick, Matthew

AU - Rosenow, Joshua M.

AU - Tate, Matthew C.

AU - Slutzky, Marc W.

PY - 2015/11/4

Y1 - 2015/11/4

N2 - Brain-machine interfaces that directly translate attempted speech from the speech motor areas could change the lives of people with complete paralysis. However, it remains uncertain exactly how speech production is encoded in cortex. Improving this understanding could greatly improve brain-machine interface design. Specifically, it is not clear to what extent the different levels of speech production (phonemes, or speech sounds, and articulatory gestures, which describe the movements of the articulator muscles) are represented in the motor cortex. Using electrocorticographic (ECoG) electrodes on the cortical surface, we recorded neural activity from speech motor and premotor areas during speech production. We decoded both gestures and phonemes using the neural signals. Overall classification accuracy was higher for gestures than phonemes. In particular, gestures were better represented in the primary sensorimotor cortices, while phonemes were better represented in more anterior areas.

AB - Brain-machine interfaces that directly translate attempted speech from the speech motor areas could change the lives of people with complete paralysis. However, it remains uncertain exactly how speech production is encoded in cortex. Improving this understanding could greatly improve brain-machine interface design. Specifically, it is not clear to what extent the different levels of speech production (phonemes, or speech sounds, and articulatory gestures, which describe the movements of the articulator muscles) are represented in the motor cortex. Using electrocorticographic (ECoG) electrodes on the cortical surface, we recorded neural activity from speech motor and premotor areas during speech production. We decoded both gestures and phonemes using the neural signals. Overall classification accuracy was higher for gestures than phonemes. In particular, gestures were better represented in the primary sensorimotor cortices, while phonemes were better represented in more anterior areas.

UR - http://www.scopus.com/inward/record.url?scp=84953280574&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953280574&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2015.7319597

DO - 10.1109/EMBC.2015.7319597

M3 - Conference contribution

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 5339

EP - 5342

BT - 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Mugler EM, Goldrick M, Rosenow JM, Tate MC, Slutzky MW. Decoding of articulatory gestures during word production using speech motor and premotor cortical activity. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 5339-5342. 7319597. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). https://doi.org/10.1109/EMBC.2015.7319597