TY - JOUR
T1 - Estimating muscle activation from EMG using deep learning-based dynamical systems models
AU - Wimalasena, Lahiru N.
AU - Braun, Jonas F.
AU - Keshtkaran, Mohammad Reza
AU - Hofmann, David
AU - Gallego, Juan Álvaro
AU - Alessandro, Cristiano
AU - Tresch, Matthew C.
AU - Miller, Lee E.
AU - Pandarinath, Chethan
N1 - Funding Information:
This work was supported by the Emory Neuromodulation and Technology Innovation Center (ENTICe), NSF NCS 1835364, DARPA PA-18-02-04-INI-FP-021, NIH Eunice Kennedy Shriver NICHD K12HD073945, NIH NINDS/OD DP2NS127291, NIH BRAIN Initiative/NIDA RF1DA055667, the Alfred P Sloan Foundation, the Burroughs Wellcome Fund, and the Simons Foundation as part of the Simons-Emory International Consortium on Motor Control (CP), NSF NCS 185345, NIH NINDS NS086973, NIH NINDS NS053603 and NS074044 (LEM), NIH NINDS NS086973 (MCT), UKRI EPSRC EP/T020970/1, Community of Madrid Talent Attraction Fellowship 2017-T2/TIC-5263 (JAG), German Academic Scholarship Foundation Fellowship 289999 and Elite Network of Bavaria Travel Allowance (JFB).
Publisher Copyright:
© 2022 IOP Publishing Ltd.
PY - 2022/6
Y1 - 2022/6
N2 - Objective. To study the neural control of movement, it is often necessary to estimate how muscles are activated across a variety of behavioral conditions. One approach is to try extracting the underlying neural command signal to muscles by applying latent variable modeling methods to electromyographic (EMG) recordings. However, estimating the latent command signal that underlies muscle activation is challenging due to its complex relation with recorded EMG signals. Common approaches estimate each muscle's activation independently or require manual tuning of model hyperparameters to preserve behaviorally-relevant features. Approach. Here, we adapted AutoLFADS, a large-scale, unsupervised deep learning approach originally designed to de-noise cortical spiking data, to estimate muscle activation from multi-muscle EMG signals. AutoLFADS uses recurrent neural networks to model the spatial and temporal regularities that underlie multi-muscle activation. Main results. We first tested AutoLFADS on muscle activity from the rat hindlimb during locomotion and found that it dynamically adjusts its frequency response characteristics across different phases of behavior. The model produced single-trial estimates of muscle activation that improved prediction of joint kinematics as compared to low-pass or Bayesian filtering. We also applied AutoLFADS to monkey forearm muscle activity recorded during an isometric wrist force task. AutoLFADS uncovered previously uncharacterized high-frequency oscillations in the EMG that enhanced the correlation with measured force. The AutoLFADS-inferred estimates of muscle activation were also more closely correlated with simultaneously-recorded motor cortical activity than were other tested approaches. Significance. This method leverages dynamical systems modeling and artificial neural networks to provide estimates of muscle activation for multiple muscles. Ultimately, the approach can be used for further studies of multi-muscle coordination and its control by upstream brain areas, and for improving brain-machine interfaces that rely on myoelectric control signals.
AB - Objective. To study the neural control of movement, it is often necessary to estimate how muscles are activated across a variety of behavioral conditions. One approach is to try extracting the underlying neural command signal to muscles by applying latent variable modeling methods to electromyographic (EMG) recordings. However, estimating the latent command signal that underlies muscle activation is challenging due to its complex relation with recorded EMG signals. Common approaches estimate each muscle's activation independently or require manual tuning of model hyperparameters to preserve behaviorally-relevant features. Approach. Here, we adapted AutoLFADS, a large-scale, unsupervised deep learning approach originally designed to de-noise cortical spiking data, to estimate muscle activation from multi-muscle EMG signals. AutoLFADS uses recurrent neural networks to model the spatial and temporal regularities that underlie multi-muscle activation. Main results. We first tested AutoLFADS on muscle activity from the rat hindlimb during locomotion and found that it dynamically adjusts its frequency response characteristics across different phases of behavior. The model produced single-trial estimates of muscle activation that improved prediction of joint kinematics as compared to low-pass or Bayesian filtering. We also applied AutoLFADS to monkey forearm muscle activity recorded during an isometric wrist force task. AutoLFADS uncovered previously uncharacterized high-frequency oscillations in the EMG that enhanced the correlation with measured force. The AutoLFADS-inferred estimates of muscle activation were also more closely correlated with simultaneously-recorded motor cortical activity than were other tested approaches. Significance. This method leverages dynamical systems modeling and artificial neural networks to provide estimates of muscle activation for multiple muscles. Ultimately, the approach can be used for further studies of multi-muscle coordination and its control by upstream brain areas, and for improving brain-machine interfaces that rely on myoelectric control signals.
KW - EMG
KW - deep learning
KW - dynamical systems
KW - motor control
UR - http://www.scopus.com/inward/record.url?scp=85130765518&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85130765518&partnerID=8YFLogxK
U2 - 10.1088/1741-2552/ac6369
DO - 10.1088/1741-2552/ac6369
M3 - Article
C2 - 35366649
AN - SCOPUS:85130765518
SN - 1741-2560
VL - 19
JO - Journal of Neural Engineering
JF - Journal of Neural Engineering
IS - 3
M1 - 036013
ER -